source('../env.R')
Linking to GEOS 3.11.0, GDAL 3.5.3, PROJ 9.1.0; sf_use_s2() is FALSE
── Attaching core tidyverse packages ─────────────────────────────────────────────────────────────────────────────────── tidyverse 2.0.0 ──
✔ dplyr     1.1.4     ✔ readr     2.1.5
✔ forcats   1.0.0     ✔ stringr   1.5.1
✔ lubridate 1.9.3     ✔ tibble    3.2.1
✔ purrr     1.0.2     ✔ tidyr     1.3.1── Conflicts ───────────────────────────────────────────────────────────────────────────────────────────────────── tidyverse_conflicts() ──
✖ dplyr::filter()    masks stats::filter()
✖ dplyr::lag()       masks stats::lag()
✖ lubridate::stamp() masks cowplot::stamp()
ℹ Use the ]8;;http://conflicted.r-lib.org/conflicted package]8;; to force all conflicts to become errors
Attaching package: ‘dbplyr’

The following objects are masked from ‘package:dplyr’:

    ident, sql

Loading required package: ape

Attaching package: ‘ape’

The following object is masked from ‘package:dplyr’:

    where

Loading required package: maps

Attaching package: ‘maps’

The following object is masked from ‘package:purrr’:

    map

Please cite the eBird Status and Trends data using: 
  Fink, D., T. Auer, A. Johnston, M. Strimas-Mackey, S. Ligocki, O. Robinson, 
  W. Hochachka, L. Jaromczyk, C. Crowley, K. Dunham, A. Stillman, I. Davies, 
  A. Rodewald, V. Ruiz-Gutierrez, C. Wood. 2023.
  eBird Status and Trends, Data Version: 2022; Released: 2023. Cornell Lab of
  Ornithology, Ithaca, New York. https://doi.org/10.2173/ebirdst.2022

This version of the package provides access to the 2022 version of the eBird
Status and Trends Data Products. Access to the 2022 data will be provided 
until November 2024 when it will be replaced by the 2023 data. At that 
point, you will be required to update this R package and transition to using 
the new data.
terra 1.7.71

Attaching package: ‘terra’

The following object is masked from ‘package:phytools’:

    rescale

The following objects are masked from ‘package:ape’:

    rotate, trans, zoom

The following object is masked from ‘package:tidyr’:

    extract

Loading required package: permute
Loading required package: lattice
This is vegan 2.6-4

Attaching package: ‘vegan’

The following object is masked from ‘package:phytools’:

    scores

Loading required package: mvtnorm
Loading required package: survival
Loading required package: TH.data
Loading required package: MASS

Attaching package: ‘MASS’

The following object is masked from ‘package:terra’:

    area

The following object is masked from ‘package:dplyr’:

    select


Attaching package: ‘TH.data’

The following object is masked from ‘package:MASS’:

    geyser


Attaching package: ‘ggpubr’

The following object is masked from ‘package:terra’:

    rotate

The following object is masked from ‘package:ape’:

    rotate

The following object is masked from ‘package:cowplot’:

    get_legend

Loading required package: nlme

Attaching package: ‘nlme’

The following object is masked from ‘package:dplyr’:

    collapse

Registered S3 method overwritten by 'GGally':
  method from   
  +.gg   ggplot2

Attaching package: ‘GGally’

The following object is masked from ‘package:terra’:

    wrap

ggtree v3.11.0 For help: https://yulab-smu.top/treedata-book/

If you use the ggtree package suite in published research, please cite the appropriate paper(s):

Guangchuang Yu, David Smith, Huachen Zhu, Yi Guan, Tommy Tsan-Yuk Lam. ggtree: an R package for visualization and annotation
of phylogenetic trees with their covariates and other associated data. Methods in Ecology and Evolution. 2017, 8(1):28-36.
doi:10.1111/2041-210X.12628

Shuangbin Xu, Lin Li, Xiao Luo, Meijun Chen, Wenli Tang, Li Zhan, Zehan Dai, Tommy T. Lam, Yi Guan, Guangchuang Yu. Ggtree:
A serialized data object for visualization of a phylogenetic tree and annotation data. iMeta 2022, 1(4):e56.
doi:10.1002/imt2.56

LG Wang, TTY Lam, S Xu, Z Dai, L Zhou, T Feng, P Guo, CW Dunn, BR Jones, T Bradley, H Zhu, Y Guan, Y Jiang, G Yu. treeio: an
R package for phylogenetic tree input and output with richly annotated and associated data. Molecular Biology and Evolution.
2020, 37(2):599-603. doi: 10.1093/molbev/msz240 

Attaching package: ‘ggtree’

The following object is masked from ‘package:nlme’:

    collapse

The following object is masked from ‘package:ggpubr’:

    rotate

The following objects are masked from ‘package:terra’:

    flip, inset, rotate

The following object is masked from ‘package:ape’:

    rotate

The following object is masked from ‘package:tidyr’:

    expand


Attaching package: ‘foreach’

The following objects are masked from ‘package:purrr’:

    accumulate, when


Attaching package: ‘scales’

The following object is masked from ‘package:terra’:

    rescale

The following object is masked from ‘package:phytools’:

    rescale

The following object is masked from ‘package:purrr’:

    discard

The following object is masked from ‘package:readr’:

    col_factor
community_data = read_csv(filename(COMMUNITY_OUTPUT_DIR, 'community_assembly_metrics_using_relative_abundance.csv'))
Rows: 341 Columns: 43── Column specification ───────────────────────────────────────────────────────────────────────────────────────────────────────────────────
Delimiter: ","
dbl (43): mntd_normalised, mntd_actual, mntd_min, mntd_max, mntd_mean, mntd_sd, fdiv_normalised, fdiv_actual, fdiv_min, fdiv_max, fdiv_...
ℹ Use `spec()` to retrieve the full column specification for this data.
ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.
head(community_data)
colnames(community_data)
 [1] "mntd_normalised"                  "mntd_actual"                      "mntd_min"                        
 [4] "mntd_max"                         "mntd_mean"                        "mntd_sd"                         
 [7] "fdiv_normalised"                  "fdiv_actual"                      "fdiv_min"                        
[10] "fdiv_max"                         "fdiv_mean"                        "fdiv_sd"                         
[13] "mass_fdiv_normalised"             "mass_fdiv_actual"                 "mass_fdiv_min"                   
[16] "mass_fdiv_max"                    "mass_fdiv_mean"                   "mass_fdiv_sd"                    
[19] "locomotory_trait_fdiv_normalised" "locomotory_trait_fdiv_actual"     "locomotory_trait_fdiv_min"       
[22] "locomotory_trait_fdiv_max"        "locomotory_trait_fdiv_mean"       "locomotory_trait_fdiv_sd"        
[25] "trophic_trait_fdiv_normalised"    "trophic_trait_fdiv_actual"        "trophic_trait_fdiv_min"          
[28] "trophic_trait_fdiv_max"           "trophic_trait_fdiv_mean"          "trophic_trait_fdiv_sd"           
[31] "gape_width_fdiv_normalised"       "gape_width_fdiv_actual"           "gape_width_fdiv_min"             
[34] "gape_width_fdiv_max"              "gape_width_fdiv_mean"             "gape_width_fdiv_sd"              
[37] "handwing_index_fdiv_normalised"   "handwing_index_fdiv_actual"       "handwing_index_fdiv_min"         
[40] "handwing_index_fdiv_max"          "handwing_index_fdiv_mean"         "handwing_index_fdiv_sd"          
[43] "city_id"                         

Join on realms

city_to_realm = read_csv(filename(CITY_DATA_OUTPUT_DIR, 'realms.csv'))
Rows: 342 Columns: 2── Column specification ───────────────────────────────────────────────────────────────────────────────────────────────────────────────────
Delimiter: ","
chr (1): core_realm
dbl (1): city_id
ℹ Use `spec()` to retrieve the full column specification for this data.
ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.
community_data_with_realm = left_join(community_data, city_to_realm)
Joining with `by = join_by(city_id)`

Cities as points

city_points = st_centroid(read_sf(filename(CITY_DATA_OUTPUT_DIR, 'city_selection.shp'))) %>% left_join(community_data_with_realm)
Warning: st_centroid assumes attributes are constant over geometriesWarning: st_centroid does not give correct centroids for longitude/latitude dataJoining with `by = join_by(city_id)`
city_points_coords = st_coordinates(city_points)
city_points$latitude = city_points_coords[,1]
city_points$longitude = city_points_coords[,2]
world_map = read_country_boundaries()
Error: Cannot open "/Users/james/Dropbox/PhD/WorldBank_countries_Admin0_10m/WB_countries_Admin0_10m.shp"; The file doesn't seem to exist.

Load community data, and create long format version

communities = read_csv(filename(COMMUNITY_OUTPUT_DIR, 'communities_for_analysis.csv'))
Rows: 2462 Columns: 12── Column specification ───────────────────────────────────────────────────────────────────────────────────────────────────────────────────
Delimiter: ","
chr (5): city_name, jetz_species_name, seasonal, presence, origin
dbl (4): city_id, distance_to_northern_edge_km, distance_to_southern_edge_km, relative_abundance_proxy
lgl (3): present_urban_high, present_urban_med, present_urban_low
ℹ Use `spec()` to retrieve the full column specification for this data.
ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.
communities
community_summary = communities %>% group_by(city_id) %>% summarise(regional_pool_size = n(), urban_pool_size = sum(relative_abundance_proxy > 0))
community_summary

Load trait data

traits = read_csv(filename(TAXONOMY_OUTPUT_DIR, 'traits_jetz.csv'))
Rows: 304 Columns: 6── Column specification ───────────────────────────────────────────────────────────────────────────────────────────────────────────────────
Delimiter: ","
chr (1): jetz_species_name
dbl (5): gape_width, trophic_trait, locomotory_trait, mass, handwing_index
ℹ Use `spec()` to retrieve the full column specification for this data.
ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.
head(traits)

Load realm geo

Summary metrics by Realm

test_required_values = function(name, df) {
  cat(paste(
    test_value_wilcox(paste(name, 'MNTD'), df$mntd_normalised),
    test_value_wilcox(paste(name, 'Beak Gape FDiv'), df$gape_width_fdiv_normalised),
    test_value_wilcox(paste(name, 'HWI FDiv'), df$handwing_index_fdiv_normalised),
    test_value_wilcox(paste(name, 'Mass FDiv'), df$mass_fdiv_normalised),
    nrow(df),
    sep = "\n"))
}
test_required_values('Global', community_data_with_realm)
Global MNTD median 0.49 
Global Beak Gape FDiv median 0.59 ***
Global HWI FDiv median 0.66 ***
Global Mass FDiv median 0.65 ***
341
unique(community_data_with_realm$core_realm)
[1] "Oceania"     "Nearctic"    "Neotropic"   "Palearctic"  "Afrotropic"  "Indomalayan" "Australasia"
test_required_values('Nearctic', community_data_with_realm[community_data_with_realm$core_realm == 'Nearctic',])
Warning: cannot compute exact p-value with tiesWarning: cannot compute exact p-value with ties
Nearctic MNTD median 0.65 
Nearctic Beak Gape FDiv median 0.63 
Nearctic HWI FDiv median 0.23 **
Nearctic Mass FDiv median 0.48 
66
test_required_values('Neotropic', community_data_with_realm[community_data_with_realm$core_realm == 'Neotropic',])
Neotropic MNTD median 0.53 
Neotropic Beak Gape FDiv median 0.46 
Neotropic HWI FDiv median 0.51 
Neotropic Mass FDiv median 0.65 ***
64
test_required_values('Palearctic', community_data_with_realm[community_data_with_realm$core_realm == 'Palearctic',])
Palearctic MNTD median 0.59 *
Palearctic Beak Gape FDiv median 0.93 ***
Palearctic HWI FDiv median 0.4 
Palearctic Mass FDiv median 0.55 
74
test_required_values('Afrotropic', community_data_with_realm[community_data_with_realm$core_realm == 'Afrotropic',])
Afrotropic MNTD median 0.17 *
Afrotropic Beak Gape FDiv median 0.4 
Afrotropic HWI FDiv median 0.54 
Afrotropic Mass FDiv median 0.34 
9
test_required_values('Indomalayan', community_data_with_realm[community_data_with_realm$core_realm == 'Indomalayan',])
Indomalayan MNTD median 0.43 ***
Indomalayan Beak Gape FDiv median 0.47 
Indomalayan HWI FDiv median 0.88 ***
Indomalayan Mass FDiv median 0.81 ***
121
test_required_values('Australasia', community_data_with_realm[community_data_with_realm$core_realm == 'Australasia',])
Australasia MNTD median 0.53 
Australasia Beak Gape FDiv median 0.46 
Australasia HWI FDiv median 0.79 
Australasia Mass FDiv median 0.55 
6

Summary metrics by introduced species

communities = read_csv(filename(COMMUNITY_OUTPUT_DIR, 'communities_for_analysis.csv'))
Rows: 2462 Columns: 12── Column specification ───────────────────────────────────────────────────────────────────────────────────────────────────────────────────
Delimiter: ","
chr (5): city_name, jetz_species_name, seasonal, presence, origin
dbl (4): city_id, distance_to_northern_edge_km, distance_to_southern_edge_km, relative_abundance_proxy
lgl (3): present_urban_high, present_urban_med, present_urban_low
ℹ Use `spec()` to retrieve the full column specification for this data.
ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.
city_introduced_species = communities %>% group_by(city_id) %>% summarise(number_of_species = n()) %>% left_join(
  communities %>% group_by(city_id) %>% filter(origin == 'Introduced') %>% summarise(number_of_introduced_species = n())
) %>% replace_na(list(number_of_introduced_species = 0))
Joining with `by = join_by(city_id)`
community_data_with_introductions = left_join(community_data, city_introduced_species)
Joining with `by = join_by(city_id)`
community_data_with_introductions$has_introduced_species = community_data_with_introductions$number_of_introduced_species > 0
community_data_with_introductions
community_data_with_introductions[,c('mntd_normalised', 'has_introduced_species')]
community_data_with_introductions %>% group_by(has_introduced_species) %>% summarise(
  total_cities = n(), 
  
  mean_mntd_normalised = mean(mntd_normalised, na.rm = T),
  sd_mntd_normalised = sd(mntd_normalised, na.rm = T),
  
  mean_mass_fdiv_normalised = mean(mass_fdiv_normalised, na.rm = T),
  sd_mass_fdiv_normalised = sd(mass_fdiv_normalised, na.rm = T),
  
  mean_gape_width_fdiv_normalised = mean(gape_width_fdiv_normalised, na.rm = T),
  sd_gape_width_fdiv_normalised = sd(gape_width_fdiv_normalised, na.rm = T),
  
  mean_handwing_index_fdiv_normalised = mean(handwing_index_fdiv_normalised, na.rm = T),
  sd_handwing_index_fdiv_normalised = sd(handwing_index_fdiv_normalised, na.rm = T)
)

MNTD

ggplot(community_data_with_introductions, aes(x = has_introduced_species, y = mntd_normalised)) + geom_boxplot()

wilcox.test(mntd_normalised ~ has_introduced_species, community_data_with_introductions, na.action = 'na.omit')

    Wilcoxon rank sum test with continuity correction

data:  mntd_normalised by has_introduced_species
W = 10956, p-value = 0.02272
alternative hypothesis: true location shift is not equal to 0

There is a significant difference between the response of cities with introduced species (0.53±0.27) and those without (0.47±0.19) (p-value = 0.02).

Mass FDiv

ggplot(community_data_with_introductions, aes(x = has_introduced_species, y = mass_fdiv_normalised)) + geom_boxplot()

wilcox.test(mass_fdiv_normalised ~ has_introduced_species, community_data_with_introductions, na.action = 'na.omit')

    Wilcoxon rank sum test with continuity correction

data:  mass_fdiv_normalised by has_introduced_species
W = 17286, p-value = 0.00000004887
alternative hypothesis: true location shift is not equal to 0

There is a significant difference between the response of cities with introduced species (0.57±0.27) and those without (0.73±0.24) (p < 0.0001)

Beak Gape FDiv

ggplot(community_data_with_introductions, aes(x = has_introduced_species, y = gape_width_fdiv_normalised)) + geom_boxplot()

wilcox.test(gape_width_fdiv_normalised ~ has_introduced_species, community_data_with_introductions, na.action = 'na.omit')

    Wilcoxon rank sum test with continuity correction

data:  gape_width_fdiv_normalised by has_introduced_species
W = 10990, p-value = 0.1178
alternative hypothesis: true location shift is not equal to 0

There is NOT a significant difference between the response of cities with introduced species (0.61±0.30) and those without (0.56±0.27)

HWI FDiv

ggplot(community_data_with_introductions, aes(x = has_introduced_species, y = handwing_index_fdiv_normalised)) + geom_boxplot()

wilcox.test(handwing_index_fdiv_normalised ~ has_introduced_species, community_data_with_introductions, na.action = 'na.omit')

    Wilcoxon rank sum test with continuity correction

data:  handwing_index_fdiv_normalised by has_introduced_species
W = 19410, p-value < 0.00000000000000022
alternative hypothesis: true location shift is not equal to 0

There is a significant difference between the response of cities with introduced species (0.49±0.30) and those without (0.79±0.21) (p < 0.0001)

Examine individual metrics

Analysis data frame

geography = read_csv(filename(CITY_DATA_OUTPUT_DIR, 'geography.csv'))
Rows: 342 Columns: 26── Column specification ───────────────────────────────────────────────────────────────────────────────────────────────────────────────────
Delimiter: ","
dbl (26): city_id, city_avg_ndvi, city_avg_elevation, city_avg_temp, city_avg_min_monthly_temp, city_avg_max_monthly_temp, city_avg_mon...
ℹ Use `spec()` to retrieve the full column specification for this data.
ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.
names(geography)
 [1] "city_id"                       "city_avg_ndvi"                 "city_avg_elevation"            "city_avg_temp"                
 [5] "city_avg_min_monthly_temp"     "city_avg_max_monthly_temp"     "city_avg_monthly_temp"         "city_avg_rainfall"            
 [9] "city_avg_max_monthly_rainfall" "city_avg_min_monthly_rainfall" "city_avg_soil_moisture"        "city_max_elev"                
[13] "city_min_elev"                 "city_elev_range"               "region_20km_avg_ndvi"          "region_20km_avg_elevation"    
[17] "region_20km_avg_soil_moisture" "region_20km_max_elev"          "region_20km_min_elev"          "region_20km_elev_range"       
[21] "region_50km_avg_ndvi"          "region_50km_avg_elevation"     "region_50km_avg_soil_moisture" "region_50km_max_elev"         
[25] "region_50km_min_elev"          "region_50km_elev_range"       
analysis_data = community_data_with_realm[,c('city_id', 'mntd_normalised', 'mass_fdiv_normalised', 'gape_width_fdiv_normalised', 'handwing_index_fdiv_normalised', 'core_realm')] %>% 
  left_join(city_points[,c('city_id', 'latitude', 'longitude')]) %>%
  left_join(community_data_with_introductions[,c('city_id', 'has_introduced_species')]) %>%
  left_join(geography)
Joining with `by = join_by(city_id)`Joining with `by = join_by(city_id)`Joining with `by = join_by(city_id)`
analysis_data$abs_latitude = abs(analysis_data$latitude)
analysis_data$core_realm = factor(analysis_data$core_realm, levels = c('Palearctic', 'Nearctic', 'Neotropic', 'Afrotropic', 'Indomalayan', 'Australasia', 'Oceania'))
analysis_data$has_introduced_species = factor(analysis_data$has_introduced_species, level = c('TRUE', 'FALSE'), labels = c('Introduced species', 'No introduced species'))
model_data = function(df, dependant_var) {
  df[,c(dependant_var, 'core_realm', 'abs_latitude', 'latitude', 'longitude', 'has_introduced_species', 'city_avg_ndvi', 'city_avg_elevation', 'city_avg_temp', 'city_avg_min_monthly_temp', 'city_avg_max_monthly_temp', 'city_avg_monthly_temp', 'city_avg_rainfall', 'city_avg_max_monthly_rainfall', 'city_avg_min_monthly_rainfall', 'city_avg_soil_moisture', 'city_max_elev', 'city_min_elev', 'city_elev_range', 'region_20km_avg_ndvi', 'region_20km_avg_elevation', 'region_20km_avg_soil_moisture', 'region_20km_max_elev', 'region_20km_min_elev', 'region_20km_elev_range', 'region_50km_avg_ndvi', 'region_50km_avg_elevation', 'region_50km_avg_soil_moisture', 'region_50km_max_elev', 'region_50km_min_elev', 'region_50km_elev_range')]
}
model_data(analysis_data, 'mntd_normalised')
names(analysis_data)
 [1] "city_id"                        "mntd_normalised"                "mass_fdiv_normalised"           "gape_width_fdiv_normalised"    
 [5] "handwing_index_fdiv_normalised" "core_realm"                     "latitude"                       "longitude"                     
 [9] "geometry"                       "has_introduced_species"         "city_avg_ndvi"                  "city_avg_elevation"            
[13] "city_avg_temp"                  "city_avg_min_monthly_temp"      "city_avg_max_monthly_temp"      "city_avg_monthly_temp"         
[17] "city_avg_rainfall"              "city_avg_max_monthly_rainfall"  "city_avg_min_monthly_rainfall"  "city_avg_soil_moisture"        
[21] "city_max_elev"                  "city_min_elev"                  "city_elev_range"                "region_20km_avg_ndvi"          
[25] "region_20km_avg_elevation"      "region_20km_avg_soil_moisture"  "region_20km_max_elev"           "region_20km_min_elev"          
[29] "region_20km_elev_range"         "region_50km_avg_ndvi"           "region_50km_avg_elevation"      "region_50km_avg_soil_moisture" 
[33] "region_50km_max_elev"           "region_50km_min_elev"           "region_50km_elev_range"         "abs_latitude"                  
all_explanatories = c(
    'abs_latitude', 'latitude', 'longitude', 
    'has_introduced_species',
    'city_avg_ndvi', 'city_avg_elevation', 'city_avg_temp', 'city_avg_min_monthly_temp', 'city_avg_max_monthly_temp', 
    'city_avg_monthly_temp', 'city_avg_rainfall', 'city_avg_max_monthly_rainfall', 'city_avg_min_monthly_rainfall', 
    'city_avg_soil_moisture', 'city_max_elev', 'city_min_elev', 'city_elev_range',
    'region_20km_avg_ndvi', 'region_20km_avg_elevation', 'region_20km_avg_soil_moisture', 'region_20km_max_elev', 
    'region_20km_min_elev', 'region_20km_elev_range',
    'region_50km_avg_ndvi', 'region_50km_avg_elevation', 'region_50km_avg_soil_moisture', 'region_50km_max_elev', 
    'region_50km_min_elev', 'region_50km_elev_range',
    'core_realmAfrotropic', 'core_realmAustralasia', 'core_realmIndomalayan', 'core_realmNearctic', 'core_realmNeotropic', 'core_realmPalearctic')

type_labels = function(p) {
  explanatory_levels = all_explanatories[all_explanatories %in% p$explanatory]
  p$explanatory <- factor(p$explanatory, levels = explanatory_levels)
  
  p$type <- 'Realm'
  p$type[p$explanatory %in% c('city_avg_ndvi', 'city_avg_elevation', 'city_avg_temp', 'city_avg_min_monthly_temp', 'city_avg_max_monthly_temp', 
    'city_avg_monthly_temp', 'city_avg_rainfall', 'city_avg_max_monthly_rainfall', 'city_avg_min_monthly_rainfall', 
    'city_avg_soil_moisture', 'city_max_elev', 'city_min_elev', 'city_elev_range')] <- 'City geography'
  p$type[p$explanatory %in% c('region_50km_avg_ndvi', 'region_50km_avg_elevation', 'region_50km_avg_soil_moisture', 'region_50km_max_elev', 
    'region_50km_min_elev', 'region_50km_elev_range')] <- 'Regional (50km) geography'
   p$type[p$explanatory %in% c('region_20km_avg_ndvi', 'region_20km_avg_elevation', 'region_20km_avg_soil_moisture', 'region_20km_max_elev', 
    'region_20km_min_elev', 'region_20km_elev_range')] <- 'Regional (20km) geography'
  p$type[p$explanatory %in% c('abs_latitude', 'latitude', 'longitude')] <- 'Spatial'
  p
}
explanatory_labels = c(
  'has_introduced_species'='Has introduced species', 
  'city_avg_ndvi'='Average NDVI', 
  'city_avg_elevation'='Average elevation', 
  'city_avg_temp'='Average temperature', 
  'city_avg_min_monthly_temp'='Average minimum monthly temperature', 
  'city_avg_max_monthly_temp'='Average maximum monthly temperature', 
  'city_avg_monthly_temp'='Average monthly temperature', 
  'city_avg_rainfall'='Average rainfall', 
  'city_avg_max_monthly_rainfall'='Average maximum monthly rainfall', 
  'city_avg_min_monthly_rainfall'='Average minimum monthly rainfall', 
  'city_avg_soil_moisture'='Average soil moisture', 
  'city_max_elev'='Maximum elevation', 
  'city_min_elev'='Minimum elevation', 
  'city_elev_range'='Elevation range', 
  'region_20km_avg_ndvi'='Average NDVI', 
  'region_20km_avg_elevation'='Average elevation', 
  'region_20km_avg_soil_moisture'='Average soil moisture', 
  'region_20km_max_elev'='Maximum elevation', 
  'region_20km_min_elev'='Minimum elevation',
  'region_20km_elev_range'='Elevation range',
  'region_50km_avg_ndvi'='Average NDVI',
  'region_50km_avg_elevation'='Average elevation',
  'region_50km_avg_soil_moisture'='Average soil moisture', 
  'region_50km_max_elev'='Maximum elevation',
  'region_50km_min_elev'='Minimum elevation', 
  'region_50km_elev_range'='Elevation range',
  'abs_latitude' = 'Absolute latitude',
  'latitude' = 'Latitude',
  'longitude' = 'Longitude',
  'core_realmAfrotropic' = 'Afrotropical', 
  'core_realmAustralasia' = 'Austaliasian', 
  'core_realmIndomalayan' = 'Indomalayan', 
  'core_realmNearctic' = 'Nearctic', 
  'core_realmNeotropic' = 'Neotropical',
  'core_realmPalearctic' = 'Palearctic',
  'core_realmOceania' = 'Oceanical')

Helper plot functions

geom_normalised_histogram = function(name, gg, legend.position = "bottom") {
  gg + 
    geom_histogram(aes(fill = core_realm), binwidth = 0.1, position = "dodge") +
    geom_vline(aes(xintercept = 0.5), color = "#000000", size = 0.4) +
    geom_vline(aes(xintercept = 0), color = "#000000", size = 0.2, linetype = "dashed") +
    geom_vline(aes(xintercept = 1), color = "#000000", size = 0.2, linetype = "dashed") + 
    ylab("Number of cities") + xlab("Normalised Response") + ylim(c(0, 70)) +
    labs(title = name, fill = 'Realm') +
    theme_bw() +
    theme(legend.position=legend.position)
}
geom_map = function(map_sf, title) {
  norm_mntd_analysis_geo = ggplot() + 
    geom_sf(data = world_map, aes(geometry = geometry)) +
    map_sf +
    normalised_colours_scale +
    labs(colour = 'Normalised\nResponse') +
    theme_bw() +
    theme(legend.position="bottom")
}

Helper Dredge functions

# Taken from MuMIN package
# https://rdrr.io/cran/MuMIn/src/R/averaging.R
# https://rdrr.io/cran/MuMIn/src/R/model.avg.R

.coefarr.avg <-
  function(cfarr, weight, revised.var, full, alpha) {   
    weight <- weight / sum(weight)
    nCoef <- dim(cfarr)[3L]
    if(full) {
      nas <- is.na(cfarr[, 1L, ]) & is.na(cfarr[, 2L, ])
      cfarr[, 1L, ][nas] <- cfarr[, 2L, ][nas] <- 0
      #cfarr[, 1L:2L, ][is.na(cfarr[, 1L:2L, ])] <- 0
      if(!all(is.na(cfarr[, 3L, ])))
        cfarr[ ,3L, ][is.na(cfarr[ , 3L, ])] <- Inf
    }
    
    avgcoef <- array(dim = c(nCoef, 5L),
                     dimnames = list(dimnames(cfarr)[[3L]], c("Estimate",
                                                              "Std. Error", "Adjusted SE", "Lower CI", "Upper CI")))
    for(i in seq_len(nCoef))
      avgcoef[i, ] <- par.avg(cfarr[, 1L, i], cfarr[, 2L, i], weight,
                              df = cfarr[, 3L, i], alpha = alpha, revised.var = revised.var)
    
    avgcoef[is.nan(avgcoef)] <- NA
    return(avgcoef)
  }

.makecoefmat <- function(cf) {
  no.ase <- all(is.na(cf[, 3L]))
  z <- abs(cf[, 1L] / cf[, if(no.ase) 2L else 3L])
  pval <- 2 * pnorm(z, lower.tail = FALSE)
  cbind(cf[, if(no.ase) 1L:2L else 1L:3L, drop = FALSE],
        `z value` = z, `Pr(>|z|)` = zapsmall(pval))
}

# Generate model selections using lmer, dredge, and model.avg
# `forumla` : a two-sided linear formula object describing both the fixed-effects and random-effects part of the model
# `data` : the data frame containing the variables from the formula
# `aic_delta` : the AIC delta to use for selecting models in model average
model_average <- function(formula, data, aic_delta = 20) {
  model <- lm(
    formula,
    data=data
  )
  dredge_result <- dredge(model)
  summary(model.avg(dredge_result, subset = delta < aic_delta))
}

# Create a summary data frame containing the selected variables from a model
# `model_sum` : The model summary output from `model_average`
model_summary <- function(model_sum) {
  .column_name <- function(postfix) {
    postfix
  }
  
  # just return the estimate and p value
  weight <- model_sum$msTable[, 5L]
  
  coefmat.full <- as.data.frame(.makecoefmat(.coefarr.avg(model_sum$coefArray, weight,
                                                          attr(model_sum, "revised.var"), TRUE, 0.05)))
  
  coefmat.subset <-
    as.data.frame(.makecoefmat(.coefarr.avg(model_sum$coefArray, weight,
                                            attr(model_sum, "revised.var"), FALSE, 0.05)))
  
  
  coefmat.subset <- coefmat.subset[-c(1), c(1, 2, 5)]
  names(coefmat.subset) <- c(.column_name("estimate"), .column_name("error"), .column_name("p"))
  coefmat.subset <- tibble::rownames_to_column(coefmat.subset, "explanatory")
  coefmat.subset$model = 'subset'
  
  coefmat.full <- coefmat.full[-c(1), c(1, 2, 5)]
  names(coefmat.full) <- c(.column_name("estimate"), .column_name("error"), .column_name("p"))
  coefmat.full <- tibble::rownames_to_column(coefmat.full, "explanatory")
  coefmat.full$model = 'full'
  
  rbind(coefmat.full, coefmat.subset)
}
formula_from_vsurp = function(predictors, dependent, vsurp_result) {
  as.formula(paste(dependent, paste(names(predictors[,vsurp_result$varselect.interp]), collapse="+"), sep = "~"))
}
plot_vsurp_result = function(result_table) {
  plot = result_table[result_table$model == 'full',]
  plot = type_labels(plot)

  ggplot(plot, aes(y=explanatory, x=estimate, colour = type)) + 
    geom_line() +
    geom_point()+
    geom_errorbar(aes(xmin=estimate-error, xmax=estimate+error), width=.2,
                   position=position_dodge(0.05)) +
    scale_y_discrete(
      limits = rev(levels(plot$explanatory)), 
      labels = explanatory_labels) +
    theme_bw() +
    geom_vline(xintercept=0, linetype="dotted") +
    guides(colour=guide_legend(title="Predictor type")) + xlab('Increase from 0 (habitat filtering)\nto 1 (competitive exclusion)\n± Standard Error') + ylab('Predictor') +
    theme(legend.justification = "top")
}

MNTD

norm_mntd_analysis_plot = geom_normalised_histogram(
  'MNTD', 
  ggplot(analysis_data, aes(mntd_normalised))
)
norm_mntd_analysis_plot

norm_mntd_analysis_geo_plot = geom_map(geom_sf(data = analysis_data, aes(color = mntd_normalised, geometry = geometry)), 'MNTD')
norm_mntd_analysis_geo_plot
ggsave(filename(FIGURES_OUTPUT_DIR, 'normalised_mntd_using_abundance.jpg'), width = 2500, height=1100, units = 'px')

norm_mntd_analysis_data = model_data(analysis_data[!is.na(analysis_data$mntd_normalised),], 'mntd_normalised')
norm_mntd_analysis_predictors = norm_mntd_analysis_data[,-1]
norm_mntd_analysis_interp = VSURF(x = norm_mntd_analysis_predictors, y = norm_mntd_analysis_data$mntd_normalised)
Thresholding step
Estimated computational time (on one core): 18 sec.

  |                                                                                                                                       
  |                                                                                                                                 |   0%
  |                                                                                                                                       
  |======                                                                                                                           |   5%
  |                                                                                                                                       
  |=============                                                                                                                    |  10%
  |                                                                                                                                       
  |===================                                                                                                              |  15%
  |                                                                                                                                       
  |==========================                                                                                                       |  20%
  |                                                                                                                                       
  |================================                                                                                                 |  25%
  |                                                                                                                                       
  |=======================================                                                                                          |  30%
  |                                                                                                                                       
  |=============================================                                                                                    |  35%
  |                                                                                                                                       
  |====================================================                                                                             |  40%
  |                                                                                                                                       
  |==========================================================                                                                       |  45%
  |                                                                                                                                       
  |================================================================                                                                 |  50%
  |                                                                                                                                       
  |=======================================================================                                                          |  55%
  |                                                                                                                                       
  |=============================================================================                                                    |  60%
  |                                                                                                                                       
  |====================================================================================                                             |  65%
  |                                                                                                                                       
  |==========================================================================================                                       |  70%
  |                                                                                                                                       
  |=================================================================================================                                |  75%
  |                                                                                                                                       
  |=======================================================================================================                          |  80%
  |                                                                                                                                       
  |==============================================================================================================                   |  85%
  |                                                                                                                                       
  |====================================================================================================================             |  90%
  |                                                                                                                                       
  |===========================================================================================================================      |  95%
  |                                                                                                                                       
  |=================================================================================================================================| 100%
Interpretation step (on 29 variables)
Estimated computational time (on one core): between 7 sec. and  31.3 sec.

  |                                                                                                                                       
  |                                                                                                                                 |   0%
  |                                                                                                                                       
  |====                                                                                                                             |   3%
  |                                                                                                                                       
  |=========                                                                                                                        |   7%
  |                                                                                                                                       
  |=============                                                                                                                    |  10%
  |                                                                                                                                       
  |==================                                                                                                               |  14%
  |                                                                                                                                       
  |======================                                                                                                           |  17%
  |                                                                                                                                       
  |===========================                                                                                                      |  21%
  |                                                                                                                                       
  |===============================                                                                                                  |  24%
  |                                                                                                                                       
  |====================================                                                                                             |  28%
  |                                                                                                                                       
  |========================================                                                                                         |  31%
  |                                                                                                                                       
  |============================================                                                                                     |  34%
  |                                                                                                                                       
  |=================================================                                                                                |  38%
  |                                                                                                                                       
  |=====================================================                                                                            |  41%
  |                                                                                                                                       
  |==========================================================                                                                       |  45%
  |                                                                                                                                       
  |==============================================================                                                                   |  48%
  |                                                                                                                                       
  |===================================================================                                                              |  52%
  |                                                                                                                                       
  |=======================================================================                                                          |  55%
  |                                                                                                                                       
  |============================================================================                                                     |  59%
  |                                                                                                                                       
  |================================================================================                                                 |  62%
  |                                                                                                                                       
  |=====================================================================================                                            |  66%
  |                                                                                                                                       
  |=========================================================================================                                        |  69%
  |                                                                                                                                       
  |=============================================================================================                                    |  72%
  |                                                                                                                                       
  |==================================================================================================                               |  76%
  |                                                                                                                                       
  |======================================================================================================                           |  79%
  |                                                                                                                                       
  |===========================================================================================================                      |  83%
  |                                                                                                                                       
  |===============================================================================================================                  |  86%
  |                                                                                                                                       
  |====================================================================================================================             |  90%
  |                                                                                                                                       
  |========================================================================================================================         |  93%
  |                                                                                                                                       
  |=============================================================================================================================    |  97%
  |                                                                                                                                       
  |=================================================================================================================================| 100%
Prediction step (on 8 variables)
Maximum estimated computational time (on one core): 2.6 sec.

  |                                                                                                                                       
  |                                                                                                                                 |   0%
  |                                                                                                                                       
  |================                                                                                                                 |  12%
  |                                                                                                                                       
  |================================                                                                                                 |  25%
  |                                                                                                                                       
  |================================================                                                                                 |  38%
  |                                                                                                                                       
  |================================================================                                                                 |  50%
  |                                                                                                                                       
  |=================================================================================                                                |  62%
  |                                                                                                                                       
  |=================================================================================================                                |  75%
  |                                                                                                                                       
  |=================================================================================================================                |  88%
  |                                                                                                                                       
  |=================================================================================================================================| 100%
names(norm_mntd_analysis_predictors[,norm_mntd_analysis_interp$varselect.interp])
[1] "city_avg_monthly_temp"     "city_avg_max_monthly_temp" "core_realm"                "longitude"                
[5] "city_avg_temp"             "latitude"                  "abs_latitude"              "city_avg_min_monthly_temp"
norm_mntd_analysis_formula = formula_from_vsurp(norm_mntd_analysis_predictors, "mntd_normalised", norm_mntd_analysis_interp)
norm_mntd_analysis_result <- model_average(norm_mntd_analysis_formula, norm_mntd_analysis_data)
Fixed term is "(Intercept)"
norm_mntd_analysis_result_table = model_summary(norm_mntd_analysis_result)
norm_mntd_analysis_result_table
norm_mntd_analysis_pred_plot = plot_vsurp_result(norm_mntd_analysis_result_table)
norm_mntd_analysis_pred_plot

Gape width - FDiv

norm_gape_fdiv_analysis_plot = geom_normalised_histogram(
  'Gape FDiv', 
  ggplot(analysis_data, aes(gape_width_fdiv_normalised))
)
norm_gape_fdiv_analysis_plot

norm_gape_fdiv_analysis_geo_plot = geom_map(geom_sf(data = analysis_data, aes(color = gape_width_fdiv_normalised, geometry = geometry)), 'Gape Width FDiv')
norm_gape_fdiv_analysis_geo_plot
ggsave(filename(FIGURES_OUTPUT_DIR, 'normalised_gape_width_using_abundance.jpg'), width = 2500, height=1100, units = 'px')

norm_gape_fdiv_analysis_data = model_data(analysis_data[!is.na(analysis_data$gape_width_fdiv_normalised),], 'gape_width_fdiv_normalised')
norm_gape_fdiv_analysis_predictors = norm_gape_fdiv_analysis_data[,-1]
norm_gape_fdiv_analysis_interp = VSURF(x = norm_gape_fdiv_analysis_predictors, y = norm_gape_fdiv_analysis_data$gape_width_fdiv_normalised)
Thresholding step
Estimated computational time (on one core): 16.1 sec.

  |                                                                                                                                       
  |                                                                                                                                 |   0%
  |                                                                                                                                       
  |======                                                                                                                           |   5%
  |                                                                                                                                       
  |=============                                                                                                                    |  10%
  |                                                                                                                                       
  |===================                                                                                                              |  15%
  |                                                                                                                                       
  |==========================                                                                                                       |  20%
  |                                                                                                                                       
  |================================                                                                                                 |  25%
  |                                                                                                                                       
  |=======================================                                                                                          |  30%
  |                                                                                                                                       
  |=============================================                                                                                    |  35%
  |                                                                                                                                       
  |====================================================                                                                             |  40%
  |                                                                                                                                       
  |==========================================================                                                                       |  45%
  |                                                                                                                                       
  |================================================================                                                                 |  50%
  |                                                                                                                                       
  |=======================================================================                                                          |  55%
  |                                                                                                                                       
  |=============================================================================                                                    |  60%
  |                                                                                                                                       
  |====================================================================================                                             |  65%
  |                                                                                                                                       
  |==========================================================================================                                       |  70%
  |                                                                                                                                       
  |=================================================================================================                                |  75%
  |                                                                                                                                       
  |=======================================================================================================                          |  80%
  |                                                                                                                                       
  |==============================================================================================================                   |  85%
  |                                                                                                                                       
  |====================================================================================================================             |  90%
  |                                                                                                                                       
  |===========================================================================================================================      |  95%
  |                                                                                                                                       
  |=================================================================================================================================| 100%
Interpretation step (on 30 variables)
Estimated computational time (on one core): between 6.3 sec. and  33.3 sec.

  |                                                                                                                                       
  |                                                                                                                                 |   0%
  |                                                                                                                                       
  |====                                                                                                                             |   3%
  |                                                                                                                                       
  |=========                                                                                                                        |   7%
  |                                                                                                                                       
  |=============                                                                                                                    |  10%
  |                                                                                                                                       
  |=================                                                                                                                |  13%
  |                                                                                                                                       
  |======================                                                                                                           |  17%
  |                                                                                                                                       
  |==========================                                                                                                       |  20%
  |                                                                                                                                       
  |==============================                                                                                                   |  23%
  |                                                                                                                                       
  |==================================                                                                                               |  27%
  |                                                                                                                                       
  |=======================================                                                                                          |  30%
  |                                                                                                                                       
  |===========================================                                                                                      |  33%
  |                                                                                                                                       
  |===============================================                                                                                  |  37%
  |                                                                                                                                       
  |====================================================                                                                             |  40%
  |                                                                                                                                       
  |========================================================                                                                         |  43%
  |                                                                                                                                       
  |============================================================                                                                     |  47%
  |                                                                                                                                       
  |================================================================                                                                 |  50%
  |                                                                                                                                       
  |=====================================================================                                                            |  53%
  |                                                                                                                                       
  |=========================================================================                                                        |  57%
  |                                                                                                                                       
  |=============================================================================                                                    |  60%
  |                                                                                                                                       
  |==================================================================================                                               |  63%
  |                                                                                                                                       
  |======================================================================================                                           |  67%
  |                                                                                                                                       
  |==========================================================================================                                       |  70%
  |                                                                                                                                       
  |===============================================================================================                                  |  73%
  |                                                                                                                                       
  |===================================================================================================                              |  77%
  |                                                                                                                                       
  |=======================================================================================================                          |  80%
  |                                                                                                                                       
  |============================================================================================================                     |  83%
  |                                                                                                                                       
  |================================================================================================================                 |  87%
  |                                                                                                                                       
  |====================================================================================================================             |  90%
  |                                                                                                                                       
  |========================================================================================================================         |  93%
  |                                                                                                                                       
  |=============================================================================================================================    |  97%
  |                                                                                                                                       
  |=================================================================================================================================| 100%
Prediction step (on 11 variables)
Maximum estimated computational time (on one core): 4.5 sec.

  |                                                                                                                                       
  |                                                                                                                                 |   0%
  |                                                                                                                                       
  |============                                                                                                                     |   9%
  |                                                                                                                                       
  |=======================                                                                                                          |  18%
  |                                                                                                                                       
  |===================================                                                                                              |  27%
  |                                                                                                                                       
  |===============================================                                                                                  |  36%
  |                                                                                                                                       
  |===========================================================                                                                      |  45%
  |                                                                                                                                       
  |======================================================================                                                           |  55%
  |                                                                                                                                       
  |==================================================================================                                               |  64%
  |                                                                                                                                       
  |==============================================================================================                                   |  73%
  |                                                                                                                                       
  |==========================================================================================================                       |  82%
  |                                                                                                                                       
  |=====================================================================================================================            |  91%
  |                                                                                                                                       
  |=================================================================================================================================| 100%
names(norm_gape_fdiv_analysis_predictors[,norm_gape_fdiv_analysis_interp$varselect.interp])
 [1] "longitude"                     "core_realm"                    "abs_latitude"                  "city_avg_max_monthly_temp"    
 [5] "city_avg_temp"                 "city_avg_min_monthly_temp"     "city_avg_max_monthly_rainfall" "city_avg_min_monthly_rainfall"
 [9] "latitude"                      "city_avg_monthly_temp"         "city_max_elev"                
norm_gape_fdiv_analysis_formula = formula_from_vsurp(norm_gape_fdiv_analysis_predictors, "gape_width_fdiv_normalised", norm_gape_fdiv_analysis_interp)
norm_gape_fdiv_analysis_result <- model_average(norm_gape_fdiv_analysis_formula, norm_gape_fdiv_analysis_data)
Fixed term is "(Intercept)"
norm_gape_fdiv_analysis_result_table = model_summary(norm_gape_fdiv_analysis_result)
norm_gape_fdiv_analysis_result_table
norm_gape_fdiv_analysis_pred_plot = plot_vsurp_result(norm_gape_fdiv_analysis_result_table)
norm_gape_fdiv_analysis_pred_plot

HWI - FDiv

norm_hwi_fdiv_loco_analysis_plot = geom_normalised_histogram(
  'HWI FDiv', 
  ggplot(analysis_data, aes(handwing_index_fdiv_normalised))
)
norm_hwi_fdiv_loco_analysis_plot

norm_hwi_fdiv_analysis_geo_plot = geom_map(geom_sf(data = analysis_data, aes(color = handwing_index_fdiv_normalised, geometry = geometry)), 'HWI FDiv')
norm_hwi_fdiv_analysis_geo_plot
ggsave(filename(FIGURES_OUTPUT_DIR, 'normalised_hwi_using_abundance.jpg'), width = 2500, height=1100, units = 'px')

norm_hwi_fdiv_analysis_data = model_data(analysis_data[!is.na(analysis_data$handwing_index_fdiv_normalised),], 'handwing_index_fdiv_normalised')
norm_hwi_fdiv_analysis_predictors = norm_hwi_fdiv_analysis_data[,-1]
norm_hwi_fdiv_analysis_interp = VSURF(x = norm_hwi_fdiv_analysis_predictors, y = norm_hwi_fdiv_analysis_data$handwing_index_fdiv_normalised)
Thresholding step
Estimated computational time (on one core): 14.2 sec.

  |                                                                                                                                       
  |                                                                                                                                 |   0%
  |                                                                                                                                       
  |======                                                                                                                           |   5%
  |                                                                                                                                       
  |=============                                                                                                                    |  10%
  |                                                                                                                                       
  |===================                                                                                                              |  15%
  |                                                                                                                                       
  |==========================                                                                                                       |  20%
  |                                                                                                                                       
  |================================                                                                                                 |  25%
  |                                                                                                                                       
  |=======================================                                                                                          |  30%
  |                                                                                                                                       
  |=============================================                                                                                    |  35%
  |                                                                                                                                       
  |====================================================                                                                             |  40%
  |                                                                                                                                       
  |==========================================================                                                                       |  45%
  |                                                                                                                                       
  |================================================================                                                                 |  50%
  |                                                                                                                                       
  |=======================================================================                                                          |  55%
  |                                                                                                                                       
  |=============================================================================                                                    |  60%
  |                                                                                                                                       
  |====================================================================================                                             |  65%
  |                                                                                                                                       
  |==========================================================================================                                       |  70%
  |                                                                                                                                       
  |=================================================================================================                                |  75%
  |                                                                                                                                       
  |=======================================================================================================                          |  80%
  |                                                                                                                                       
  |==============================================================================================================                   |  85%
  |                                                                                                                                       
  |====================================================================================================================             |  90%
  |                                                                                                                                       
  |===========================================================================================================================      |  95%
  |                                                                                                                                       
  |=================================================================================================================================| 100%
Interpretation step (on 30 variables)
Estimated computational time (on one core): between 6 sec. and  29.1 sec.

  |                                                                                                                                       
  |                                                                                                                                 |   0%
  |                                                                                                                                       
  |====                                                                                                                             |   3%
  |                                                                                                                                       
  |=========                                                                                                                        |   7%
  |                                                                                                                                       
  |=============                                                                                                                    |  10%
  |                                                                                                                                       
  |=================                                                                                                                |  13%
  |                                                                                                                                       
  |======================                                                                                                           |  17%
  |                                                                                                                                       
  |==========================                                                                                                       |  20%
  |                                                                                                                                       
  |==============================                                                                                                   |  23%
  |                                                                                                                                       
  |==================================                                                                                               |  27%
  |                                                                                                                                       
  |=======================================                                                                                          |  30%
  |                                                                                                                                       
  |===========================================                                                                                      |  33%
  |                                                                                                                                       
  |===============================================                                                                                  |  37%
  |                                                                                                                                       
  |====================================================                                                                             |  40%
  |                                                                                                                                       
  |========================================================                                                                         |  43%
  |                                                                                                                                       
  |============================================================                                                                     |  47%
  |                                                                                                                                       
  |================================================================                                                                 |  50%
  |                                                                                                                                       
  |=====================================================================                                                            |  53%
  |                                                                                                                                       
  |=========================================================================                                                        |  57%
  |                                                                                                                                       
  |=============================================================================                                                    |  60%
  |                                                                                                                                       
  |==================================================================================                                               |  63%
  |                                                                                                                                       
  |======================================================================================                                           |  67%
  |                                                                                                                                       
  |==========================================================================================                                       |  70%
  |                                                                                                                                       
  |===============================================================================================                                  |  73%
  |                                                                                                                                       
  |===================================================================================================                              |  77%
  |                                                                                                                                       
  |=======================================================================================================                          |  80%
  |                                                                                                                                       
  |============================================================================================================                     |  83%
  |                                                                                                                                       
  |================================================================================================================                 |  87%
  |                                                                                                                                       
  |====================================================================================================================             |  90%
  |                                                                                                                                       
  |========================================================================================================================         |  93%
  |                                                                                                                                       
  |=============================================================================================================================    |  97%
  |                                                                                                                                       
  |=================================================================================================================================| 100%
Prediction step (on 8 variables)
Maximum estimated computational time (on one core): 2.3 sec.

  |                                                                                                                                       
  |                                                                                                                                 |   0%
  |                                                                                                                                       
  |================                                                                                                                 |  12%
  |                                                                                                                                       
  |================================                                                                                                 |  25%
  |                                                                                                                                       
  |================================================                                                                                 |  38%
  |                                                                                                                                       
  |================================================================                                                                 |  50%
  |                                                                                                                                       
  |=================================================================================                                                |  62%
  |                                                                                                                                       
  |=================================================================================================                                |  75%
  |                                                                                                                                       
  |=================================================================================================================                |  88%
  |                                                                                                                                       
  |=================================================================================================================================| 100%
names(norm_hwi_fdiv_analysis_predictors[,norm_hwi_fdiv_analysis_interp$varselect.interp])
[1] "latitude"                      "core_realm"                    "city_avg_max_monthly_temp"     "city_avg_temp"                
[5] "longitude"                     "city_avg_max_monthly_rainfall" "region_50km_elev_range"        "region_50km_min_elev"         
norm_hwi_fdiv_analysis_formula = formula_from_vsurp(norm_hwi_fdiv_analysis_predictors, "handwing_index_fdiv_normalised", norm_hwi_fdiv_analysis_interp)
norm_hwi_fdiv_analysis_result <- model_average(norm_hwi_fdiv_analysis_formula, norm_hwi_fdiv_analysis_data)
Fixed term is "(Intercept)"
norm_hwi_fdiv_analysis_result_table = model_summary(norm_hwi_fdiv_analysis_result)
norm_hwi_fdiv_analysis_result_table
norm_hwi_fdiv_analysis_pred_plot = plot_vsurp_result(norm_hwi_fdiv_analysis_result_table)
norm_hwi_fdiv_analysis_pred_plot

Mass - FDiv

norm_mass_fdiv_loco_analysis_plot = geom_normalised_histogram(
  'Mass FDiv', 
  ggplot(analysis_data, aes(mass_fdiv_normalised))
)
norm_mass_fdiv_loco_analysis_plot

norm_mass_fdiv_analysis_geo_plot = geom_map(geom_sf(data = analysis_data, aes(color = mass_fdiv_normalised, geometry = geometry)), 'Mass FDiv')
norm_mass_fdiv_analysis_geo_plot
ggsave(filename(FIGURES_OUTPUT_DIR, 'normalised_mass_using_abundance.jpg'), width = 2500, height=1100, units = 'px')

norm_mass_fdiv_analysis_data = model_data(analysis_data[!is.na(analysis_data$mass_fdiv_normalised),], 'mass_fdiv_normalised')
norm_mass_fdiv_analysis_predictors = norm_mass_fdiv_analysis_data[,-1]
norm_mass_fdiv_analysis_interp = VSURF(x = norm_mass_fdiv_analysis_predictors, y = norm_mass_fdiv_analysis_data$mass_fdiv_normalised)
Thresholding step
Estimated computational time (on one core): 15.8 sec.

  |                                                                                                                                       
  |                                                                                                                                 |   0%
  |                                                                                                                                       
  |======                                                                                                                           |   5%
  |                                                                                                                                       
  |=============                                                                                                                    |  10%
  |                                                                                                                                       
  |===================                                                                                                              |  15%
  |                                                                                                                                       
  |==========================                                                                                                       |  20%
  |                                                                                                                                       
  |================================                                                                                                 |  25%
  |                                                                                                                                       
  |=======================================                                                                                          |  30%
  |                                                                                                                                       
  |=============================================                                                                                    |  35%
  |                                                                                                                                       
  |====================================================                                                                             |  40%
  |                                                                                                                                       
  |==========================================================                                                                       |  45%
  |                                                                                                                                       
  |================================================================                                                                 |  50%
  |                                                                                                                                       
  |=======================================================================                                                          |  55%
  |                                                                                                                                       
  |=============================================================================                                                    |  60%
  |                                                                                                                                       
  |====================================================================================                                             |  65%
  |                                                                                                                                       
  |==========================================================================================                                       |  70%
  |                                                                                                                                       
  |=================================================================================================                                |  75%
  |                                                                                                                                       
  |=======================================================================================================                          |  80%
  |                                                                                                                                       
  |==============================================================================================================                   |  85%
  |                                                                                                                                       
  |====================================================================================================================             |  90%
  |                                                                                                                                       
  |===========================================================================================================================      |  95%
  |                                                                                                                                       
  |=================================================================================================================================| 100%
Interpretation step (on 30 variables)
Estimated computational time (on one core): between 1.5 sec. and  32.4 sec.

  |                                                                                                                                       
  |                                                                                                                                 |   0%
  |                                                                                                                                       
  |====                                                                                                                             |   3%
  |                                                                                                                                       
  |=========                                                                                                                        |   7%
  |                                                                                                                                       
  |=============                                                                                                                    |  10%
  |                                                                                                                                       
  |=================                                                                                                                |  13%
  |                                                                                                                                       
  |======================                                                                                                           |  17%
  |                                                                                                                                       
  |==========================                                                                                                       |  20%
  |                                                                                                                                       
  |==============================                                                                                                   |  23%
  |                                                                                                                                       
  |==================================                                                                                               |  27%
  |                                                                                                                                       
  |=======================================                                                                                          |  30%
  |                                                                                                                                       
  |===========================================                                                                                      |  33%
  |                                                                                                                                       
  |===============================================                                                                                  |  37%
  |                                                                                                                                       
  |====================================================                                                                             |  40%
  |                                                                                                                                       
  |========================================================                                                                         |  43%
  |                                                                                                                                       
  |============================================================                                                                     |  47%
  |                                                                                                                                       
  |================================================================                                                                 |  50%
  |                                                                                                                                       
  |=====================================================================                                                            |  53%
  |                                                                                                                                       
  |=========================================================================                                                        |  57%
  |                                                                                                                                       
  |=============================================================================                                                    |  60%
  |                                                                                                                                       
  |==================================================================================                                               |  63%
  |                                                                                                                                       
  |======================================================================================                                           |  67%
  |                                                                                                                                       
  |==========================================================================================                                       |  70%
  |                                                                                                                                       
  |===============================================================================================                                  |  73%
  |                                                                                                                                       
  |===================================================================================================                              |  77%
  |                                                                                                                                       
  |=======================================================================================================                          |  80%
  |                                                                                                                                       
  |============================================================================================================                     |  83%
  |                                                                                                                                       
  |================================================================================================================                 |  87%
  |                                                                                                                                       
  |====================================================================================================================             |  90%
  |                                                                                                                                       
  |========================================================================================================================         |  93%
  |                                                                                                                                       
  |=============================================================================================================================    |  97%
  |                                                                                                                                       
  |=================================================================================================================================| 100%
Prediction step (on 5 variables)
Maximum estimated computational time (on one core): 0.9 sec.

  |                                                                                                                                       
  |                                                                                                                                 |   0%
  |                                                                                                                                       
  |==========================                                                                                                       |  20%
  |                                                                                                                                       
  |====================================================                                                                             |  40%
  |                                                                                                                                       
  |=============================================================================                                                    |  60%
  |                                                                                                                                       
  |=======================================================================================================                          |  80%
  |                                                                                                                                       
  |=================================================================================================================================| 100%
names(norm_mass_fdiv_analysis_predictors[,norm_mass_fdiv_analysis_interp$varselect.interp])
[1] "core_realm"                    "abs_latitude"                  "city_avg_temp"                 "latitude"                     
[5] "city_avg_max_monthly_rainfall"
norm_mass_fdiv_analysis_formula = formula_from_vsurp(norm_mass_fdiv_analysis_predictors, "mass_fdiv_normalised", norm_mass_fdiv_analysis_interp)
norm_mass_fdiv_analysis_result <- model_average(norm_mass_fdiv_analysis_formula, norm_mass_fdiv_analysis_data)
Fixed term is "(Intercept)"
norm_mass_fdiv_analysis_result_table = model_summary(norm_mass_fdiv_analysis_result)
norm_mass_fdiv_analysis_result_table
norm_mass_fdiv_analysis_pred_plot = plot_vsurp_result(norm_mass_fdiv_analysis_result_table)
norm_mass_fdiv_analysis_pred_plot

Create plot of differences in process response

pred_legend <- get_legend(
  # create some space to the left of the legend
  norm_hwi_fdiv_analysis_pred_plot + theme(legend.box.margin = margin(0, 0, 0, 12))
)
Warning: Removed 1 row containing missing values (`geom_line()`).`geom_line()`: Each group consists of only one observation.
ℹ Do you need to adjust the group aesthetic?Warning: Removed 1 rows containing missing values (`geom_point()`).
geo_legend <- get_legend(
  # create some space to the left of the legend
  norm_mass_fdiv_analysis_geo_plot + theme(legend.box.margin = margin(0, 0, 0, 12))
)

plot_grid(
  plot_grid(
    norm_mntd_analysis_geo_plot + theme(legend.position="none"), 
    norm_mntd_analysis_pred_plot + theme(legend.position="none"), 
    nrow = 1
  ) + draw_label("MNTD", size = 16, angle = 90, x = 0.01, y = 0.5),
  plot_grid(
    norm_gape_fdiv_analysis_geo_plot + theme(legend.position="none"), 
    norm_gape_fdiv_analysis_pred_plot + theme(legend.position="none"), 
    nrow = 1
  ) + draw_label("Gape", size = 16, angle = 90, x = 0.01, y = 0.5),
  plot_grid(
    norm_hwi_fdiv_analysis_geo_plot + theme(legend.position="none"), 
    norm_hwi_fdiv_analysis_pred_plot + theme(legend.position="none"), 
    nrow = 1
  ) + draw_label("HWI", size = 16, angle = 90, x = 0.01, y = 0.5),
  plot_grid(
    norm_mass_fdiv_analysis_geo_plot + theme(legend.position="none"), 
    norm_mass_fdiv_analysis_pred_plot + theme(legend.position="none"), 
    nrow = 1
  ) + draw_label("Mass", size = 16, angle = 90, x = 0.01, y = 0.5), 
  plot_grid(
    geo_legend, 
    pred_legend, 
    nrow = 1
  ),
  nrow = 5
)
`geom_line()`: Each group consists of only one observation.
ℹ Do you need to adjust the group aesthetic?`geom_line()`: Each group consists of only one observation.
ℹ Do you need to adjust the group aesthetic?Warning: Removed 1 row containing missing values (`geom_line()`).`geom_line()`: Each group consists of only one observation.
ℹ Do you need to adjust the group aesthetic?Warning: Removed 1 rows containing missing values (`geom_point()`).Warning: Removed 1 row containing missing values (`geom_line()`).`geom_line()`: Each group consists of only one observation.
ℹ Do you need to adjust the group aesthetic?Warning: Removed 1 rows containing missing values (`geom_point()`).

ggsave(filename(FIGURES_OUTPUT_DIR, 'process_response.jpg'), width = 2500, height=5000, units = 'px')

Compare metrics against each other

ggplot(analysis_data, aes(x = gape_width_fdiv_normalised, y = mntd_normalised, colour = core_realm)) + 
  geom_point() +
  ylab("MNTD") + 
  xlab("Gape Width FDiv") +
  theme_bw() + labs(color = "Realm")

ggplot(analysis_data, aes(x = handwing_index_fdiv_normalised, y = mntd_normalised, colour = core_realm)) + 
  geom_point() +
  ylab("MNTD") + 
  xlab("HWI FDiv") +
  theme_bw() + labs(color = "Realm")

ggplot(analysis_data, aes(x = handwing_index_fdiv_normalised, y = gape_width_fdiv_normalised, colour = core_realm)) + 
  geom_point() +
  ylab("Gape Width FDiv") + 
  xlab("HWI FDiv") +
  theme_bw() + labs(color = "Realm")

mntd_fdiv_analysis = analysis_data %>% 
  dplyr::select(city_id,  mntd_normalised, handwing_index_fdiv_normalised, gape_width_fdiv_normalised) %>%
  left_join(community_summary) %>%
  mutate(urban_pool_perc = urban_pool_size * 100 / regional_pool_size)
Joining with `by = join_by(city_id)`
mntd_fdiv_analysis
ggpairs(mntd_fdiv_analysis %>% dplyr::select(mntd_normalised, handwing_index_fdiv_normalised, gape_width_fdiv_normalised, regional_pool_size, urban_pool_size, urban_pool_perc))
ggsave(filename(FIGURES_OUTPUT_DIR, 'appendix_normalised_correlation.jpg'))
Saving 7.29 x 4.51 in image

LS0tCnRpdGxlOiAiTWV0cmljcyBmb3IgYXNzZXNzaW5nIGNvbW11bml0eSBhc3NlbWJseSBwcm9jZXNzZXMiCm91dHB1dDogaHRtbF9ub3RlYm9vawpiaWJsaW9ncmFwaHk6IC4uL3JlZi5iaWIgIAotLS0KCmBgYHtyfQpzb3VyY2UoJy4uL2Vudi5SJykKYGBgCgpgYGB7cn0KY29tbXVuaXR5X2RhdGEgPSByZWFkX2NzdihmaWxlbmFtZShDT01NVU5JVFlfT1VUUFVUX0RJUiwgJ2NvbW11bml0eV9hc3NlbWJseV9tZXRyaWNzX3VzaW5nX3JlbGF0aXZlX2FidW5kYW5jZS5jc3YnKSkKaGVhZChjb21tdW5pdHlfZGF0YSkKY29sbmFtZXMoY29tbXVuaXR5X2RhdGEpCmBgYAoKSm9pbiBvbiByZWFsbXMKYGBge3J9CmNpdHlfdG9fcmVhbG0gPSByZWFkX2NzdihmaWxlbmFtZShDSVRZX0RBVEFfT1VUUFVUX0RJUiwgJ3JlYWxtcy5jc3YnKSkKY29tbXVuaXR5X2RhdGFfd2l0aF9yZWFsbSA9IGxlZnRfam9pbihjb21tdW5pdHlfZGF0YSwgY2l0eV90b19yZWFsbSkKYGBgCgpDaXRpZXMgYXMgcG9pbnRzCmBgYHtyfQpjaXR5X3BvaW50cyA9IHN0X2NlbnRyb2lkKHJlYWRfc2YoZmlsZW5hbWUoQ0lUWV9EQVRBX09VVFBVVF9ESVIsICdjaXR5X3NlbGVjdGlvbi5zaHAnKSkpICU+JSBsZWZ0X2pvaW4oY29tbXVuaXR5X2RhdGFfd2l0aF9yZWFsbSkKY2l0eV9wb2ludHNfY29vcmRzID0gc3RfY29vcmRpbmF0ZXMoY2l0eV9wb2ludHMpCmNpdHlfcG9pbnRzJGxhdGl0dWRlID0gY2l0eV9wb2ludHNfY29vcmRzWywxXQpjaXR5X3BvaW50cyRsb25naXR1ZGUgPSBjaXR5X3BvaW50c19jb29yZHNbLDJdCmBgYAogIApgYGB7cn0Kd29ybGRfbWFwID0gcmVhZF9jb3VudHJ5X2JvdW5kYXJpZXMoKQpgYGAKCkxvYWQgY29tbXVuaXR5IGRhdGEsIGFuZCBjcmVhdGUgbG9uZyBmb3JtYXQgdmVyc2lvbgpgYGB7cn0KY29tbXVuaXRpZXMgPSByZWFkX2NzdihmaWxlbmFtZShDT01NVU5JVFlfT1VUUFVUX0RJUiwgJ2NvbW11bml0aWVzX2Zvcl9hbmFseXNpcy5jc3YnKSkKY29tbXVuaXRpZXMKYGBgCgpgYGB7cn0KY29tbXVuaXR5X3N1bW1hcnkgPSBjb21tdW5pdGllcyAlPiUgZ3JvdXBfYnkoY2l0eV9pZCkgJT4lIHN1bW1hcmlzZShyZWdpb25hbF9wb29sX3NpemUgPSBuKCksIHVyYmFuX3Bvb2xfc2l6ZSA9IHN1bShyZWxhdGl2ZV9hYnVuZGFuY2VfcHJveHkgPiAwKSkKY29tbXVuaXR5X3N1bW1hcnkKYGBgCgpMb2FkIHRyYWl0IGRhdGEKYGBge3J9CnRyYWl0cyA9IHJlYWRfY3N2KGZpbGVuYW1lKFRBWE9OT01ZX09VVFBVVF9ESVIsICd0cmFpdHNfamV0ei5jc3YnKSkKaGVhZCh0cmFpdHMpCmBgYAoKTG9hZCByZWFsbSBnZW8KYGBge3J9CnJlc29sdmUgPSByZWFkX3Jlc29sdmUoKQpoZWFkKHJlc29sdmUpCmBgYAoKIyBTdW1tYXJ5IG1ldHJpY3MgYnkgUmVhbG0KYGBge3J9CnRlc3RfcmVxdWlyZWRfdmFsdWVzID0gZnVuY3Rpb24obmFtZSwgZGYpIHsKICBjYXQocGFzdGUoCiAgICB0ZXN0X3ZhbHVlX3dpbGNveChwYXN0ZShuYW1lLCAnTU5URCcpLCBkZiRtbnRkX25vcm1hbGlzZWQpLAogICAgdGVzdF92YWx1ZV93aWxjb3gocGFzdGUobmFtZSwgJ0JlYWsgR2FwZSBGRGl2JyksIGRmJGdhcGVfd2lkdGhfZmRpdl9ub3JtYWxpc2VkKSwKICAgIHRlc3RfdmFsdWVfd2lsY294KHBhc3RlKG5hbWUsICdIV0kgRkRpdicpLCBkZiRoYW5kd2luZ19pbmRleF9mZGl2X25vcm1hbGlzZWQpLAogICAgdGVzdF92YWx1ZV93aWxjb3gocGFzdGUobmFtZSwgJ01hc3MgRkRpdicpLCBkZiRtYXNzX2ZkaXZfbm9ybWFsaXNlZCksCiAgICBucm93KGRmKSwKICAgIHNlcCA9ICJcbiIpKQp9CmBgYAoKYGBge3J9CnRlc3RfcmVxdWlyZWRfdmFsdWVzKCdHbG9iYWwnLCBjb21tdW5pdHlfZGF0YV93aXRoX3JlYWxtKQpgYGAKCmBgYHtyfQp1bmlxdWUoY29tbXVuaXR5X2RhdGFfd2l0aF9yZWFsbSRjb3JlX3JlYWxtKQpgYGAKCmBgYHtyfQp0ZXN0X3JlcXVpcmVkX3ZhbHVlcygnTmVhcmN0aWMnLCBjb21tdW5pdHlfZGF0YV93aXRoX3JlYWxtW2NvbW11bml0eV9kYXRhX3dpdGhfcmVhbG0kY29yZV9yZWFsbSA9PSAnTmVhcmN0aWMnLF0pCmBgYAoKYGBge3J9CnRlc3RfcmVxdWlyZWRfdmFsdWVzKCdOZW90cm9waWMnLCBjb21tdW5pdHlfZGF0YV93aXRoX3JlYWxtW2NvbW11bml0eV9kYXRhX3dpdGhfcmVhbG0kY29yZV9yZWFsbSA9PSAnTmVvdHJvcGljJyxdKQpgYGAKCmBgYHtyfQp0ZXN0X3JlcXVpcmVkX3ZhbHVlcygnUGFsZWFyY3RpYycsIGNvbW11bml0eV9kYXRhX3dpdGhfcmVhbG1bY29tbXVuaXR5X2RhdGFfd2l0aF9yZWFsbSRjb3JlX3JlYWxtID09ICdQYWxlYXJjdGljJyxdKQpgYGAKCmBgYHtyfQp0ZXN0X3JlcXVpcmVkX3ZhbHVlcygnQWZyb3Ryb3BpYycsIGNvbW11bml0eV9kYXRhX3dpdGhfcmVhbG1bY29tbXVuaXR5X2RhdGFfd2l0aF9yZWFsbSRjb3JlX3JlYWxtID09ICdBZnJvdHJvcGljJyxdKQpgYGAKCmBgYHtyfQp0ZXN0X3JlcXVpcmVkX3ZhbHVlcygnSW5kb21hbGF5YW4nLCBjb21tdW5pdHlfZGF0YV93aXRoX3JlYWxtW2NvbW11bml0eV9kYXRhX3dpdGhfcmVhbG0kY29yZV9yZWFsbSA9PSAnSW5kb21hbGF5YW4nLF0pCmBgYAoKYGBge3J9CnRlc3RfcmVxdWlyZWRfdmFsdWVzKCdBdXN0cmFsYXNpYScsIGNvbW11bml0eV9kYXRhX3dpdGhfcmVhbG1bY29tbXVuaXR5X2RhdGFfd2l0aF9yZWFsbSRjb3JlX3JlYWxtID09ICdBdXN0cmFsYXNpYScsXSkKYGBgCgojIFN1bW1hcnkgbWV0cmljcyBieSBpbnRyb2R1Y2VkIHNwZWNpZXMKYGBge3J9CmNvbW11bml0aWVzID0gcmVhZF9jc3YoZmlsZW5hbWUoQ09NTVVOSVRZX09VVFBVVF9ESVIsICdjb21tdW5pdGllc19mb3JfYW5hbHlzaXMuY3N2JykpCmNpdHlfaW50cm9kdWNlZF9zcGVjaWVzID0gY29tbXVuaXRpZXMgJT4lIGdyb3VwX2J5KGNpdHlfaWQpICU+JSBzdW1tYXJpc2UobnVtYmVyX29mX3NwZWNpZXMgPSBuKCkpICU+JSBsZWZ0X2pvaW4oCiAgY29tbXVuaXRpZXMgJT4lIGdyb3VwX2J5KGNpdHlfaWQpICU+JSBmaWx0ZXIob3JpZ2luID09ICdJbnRyb2R1Y2VkJykgJT4lIHN1bW1hcmlzZShudW1iZXJfb2ZfaW50cm9kdWNlZF9zcGVjaWVzID0gbigpKQopICU+JSByZXBsYWNlX25hKGxpc3QobnVtYmVyX29mX2ludHJvZHVjZWRfc3BlY2llcyA9IDApKQoKY29tbXVuaXR5X2RhdGFfd2l0aF9pbnRyb2R1Y3Rpb25zID0gbGVmdF9qb2luKGNvbW11bml0eV9kYXRhLCBjaXR5X2ludHJvZHVjZWRfc3BlY2llcykKY29tbXVuaXR5X2RhdGFfd2l0aF9pbnRyb2R1Y3Rpb25zJGhhc19pbnRyb2R1Y2VkX3NwZWNpZXMgPSBjb21tdW5pdHlfZGF0YV93aXRoX2ludHJvZHVjdGlvbnMkbnVtYmVyX29mX2ludHJvZHVjZWRfc3BlY2llcyA+IDAKY29tbXVuaXR5X2RhdGFfd2l0aF9pbnRyb2R1Y3Rpb25zCmBgYAoKYGBge3J9CmNvbW11bml0eV9kYXRhX3dpdGhfaW50cm9kdWN0aW9uc1ssYygnbW50ZF9ub3JtYWxpc2VkJywgJ2hhc19pbnRyb2R1Y2VkX3NwZWNpZXMnKV0KYGBgCgpgYGB7cn0KY29tbXVuaXR5X2RhdGFfd2l0aF9pbnRyb2R1Y3Rpb25zICU+JSBncm91cF9ieShoYXNfaW50cm9kdWNlZF9zcGVjaWVzKSAlPiUgc3VtbWFyaXNlKAogIHRvdGFsX2NpdGllcyA9IG4oKSwgCiAgCiAgbWVhbl9tbnRkX25vcm1hbGlzZWQgPSBtZWFuKG1udGRfbm9ybWFsaXNlZCwgbmEucm0gPSBUKSwKICBzZF9tbnRkX25vcm1hbGlzZWQgPSBzZChtbnRkX25vcm1hbGlzZWQsIG5hLnJtID0gVCksCiAgCiAgbWVhbl9tYXNzX2ZkaXZfbm9ybWFsaXNlZCA9IG1lYW4obWFzc19mZGl2X25vcm1hbGlzZWQsIG5hLnJtID0gVCksCiAgc2RfbWFzc19mZGl2X25vcm1hbGlzZWQgPSBzZChtYXNzX2ZkaXZfbm9ybWFsaXNlZCwgbmEucm0gPSBUKSwKICAKICBtZWFuX2dhcGVfd2lkdGhfZmRpdl9ub3JtYWxpc2VkID0gbWVhbihnYXBlX3dpZHRoX2ZkaXZfbm9ybWFsaXNlZCwgbmEucm0gPSBUKSwKICBzZF9nYXBlX3dpZHRoX2ZkaXZfbm9ybWFsaXNlZCA9IHNkKGdhcGVfd2lkdGhfZmRpdl9ub3JtYWxpc2VkLCBuYS5ybSA9IFQpLAogIAogIG1lYW5faGFuZHdpbmdfaW5kZXhfZmRpdl9ub3JtYWxpc2VkID0gbWVhbihoYW5kd2luZ19pbmRleF9mZGl2X25vcm1hbGlzZWQsIG5hLnJtID0gVCksCiAgc2RfaGFuZHdpbmdfaW5kZXhfZmRpdl9ub3JtYWxpc2VkID0gc2QoaGFuZHdpbmdfaW5kZXhfZmRpdl9ub3JtYWxpc2VkLCBuYS5ybSA9IFQpCikKYGBgCgojIyBNTlRECmBgYHtyfQpnZ3Bsb3QoY29tbXVuaXR5X2RhdGFfd2l0aF9pbnRyb2R1Y3Rpb25zLCBhZXMoeCA9IGhhc19pbnRyb2R1Y2VkX3NwZWNpZXMsIHkgPSBtbnRkX25vcm1hbGlzZWQpKSArIGdlb21fYm94cGxvdCgpCmBgYAoKYGBge3J9CndpbGNveC50ZXN0KG1udGRfbm9ybWFsaXNlZCB+IGhhc19pbnRyb2R1Y2VkX3NwZWNpZXMsIGNvbW11bml0eV9kYXRhX3dpdGhfaW50cm9kdWN0aW9ucywgbmEuYWN0aW9uID0gJ25hLm9taXQnKQpgYGAKClRoZXJlIGlzIGEgc2lnbmlmaWNhbnQgZGlmZmVyZW5jZSBiZXR3ZWVuIHRoZSByZXNwb25zZSBvZiBjaXRpZXMgd2l0aCBpbnRyb2R1Y2VkIHNwZWNpZXMgKDAuNTPCsTAuMjcpIGFuZCB0aG9zZSB3aXRob3V0ICgwLjQ3wrEwLjE5KSAocC12YWx1ZSA9IDAuMDIpLgoKCiMjIE1hc3MgRkRpdgpgYGB7cn0KZ2dwbG90KGNvbW11bml0eV9kYXRhX3dpdGhfaW50cm9kdWN0aW9ucywgYWVzKHggPSBoYXNfaW50cm9kdWNlZF9zcGVjaWVzLCB5ID0gbWFzc19mZGl2X25vcm1hbGlzZWQpKSArIGdlb21fYm94cGxvdCgpCmBgYAoKYGBge3J9CndpbGNveC50ZXN0KG1hc3NfZmRpdl9ub3JtYWxpc2VkIH4gaGFzX2ludHJvZHVjZWRfc3BlY2llcywgY29tbXVuaXR5X2RhdGFfd2l0aF9pbnRyb2R1Y3Rpb25zLCBuYS5hY3Rpb24gPSAnbmEub21pdCcpCmBgYApUaGVyZSBpcyBhIHNpZ25pZmljYW50IGRpZmZlcmVuY2UgYmV0d2VlbiB0aGUgcmVzcG9uc2Ugb2YgY2l0aWVzIHdpdGggaW50cm9kdWNlZCBzcGVjaWVzICgwLjU3wrEwLjI3KSBhbmQgdGhvc2Ugd2l0aG91dCAoMC43M8KxMC4yNCkgKHAgPCAwLjAwMDEpCgoKIyMgQmVhayBHYXBlIEZEaXYKYGBge3J9CmdncGxvdChjb21tdW5pdHlfZGF0YV93aXRoX2ludHJvZHVjdGlvbnMsIGFlcyh4ID0gaGFzX2ludHJvZHVjZWRfc3BlY2llcywgeSA9IGdhcGVfd2lkdGhfZmRpdl9ub3JtYWxpc2VkKSkgKyBnZW9tX2JveHBsb3QoKQpgYGAKCmBgYHtyfQp3aWxjb3gudGVzdChnYXBlX3dpZHRoX2ZkaXZfbm9ybWFsaXNlZCB+IGhhc19pbnRyb2R1Y2VkX3NwZWNpZXMsIGNvbW11bml0eV9kYXRhX3dpdGhfaW50cm9kdWN0aW9ucywgbmEuYWN0aW9uID0gJ25hLm9taXQnKQpgYGAKVGhlcmUgaXMgTk9UIGEgc2lnbmlmaWNhbnQgZGlmZmVyZW5jZSBiZXR3ZWVuIHRoZSByZXNwb25zZSBvZiBjaXRpZXMgd2l0aCBpbnRyb2R1Y2VkIHNwZWNpZXMgKDAuNjHCsTAuMzApIGFuZCB0aG9zZSB3aXRob3V0ICgwLjU2wrEwLjI3KQoKCiMjIEhXSSBGRGl2CmBgYHtyfQpnZ3Bsb3QoY29tbXVuaXR5X2RhdGFfd2l0aF9pbnRyb2R1Y3Rpb25zLCBhZXMoeCA9IGhhc19pbnRyb2R1Y2VkX3NwZWNpZXMsIHkgPSBoYW5kd2luZ19pbmRleF9mZGl2X25vcm1hbGlzZWQpKSArIGdlb21fYm94cGxvdCgpCmBgYAoKYGBge3J9CndpbGNveC50ZXN0KGhhbmR3aW5nX2luZGV4X2ZkaXZfbm9ybWFsaXNlZCB+IGhhc19pbnRyb2R1Y2VkX3NwZWNpZXMsIGNvbW11bml0eV9kYXRhX3dpdGhfaW50cm9kdWN0aW9ucywgbmEuYWN0aW9uID0gJ25hLm9taXQnKQpgYGAKVGhlcmUgaXMgYSBzaWduaWZpY2FudCBkaWZmZXJlbmNlIGJldHdlZW4gdGhlIHJlc3BvbnNlIG9mIGNpdGllcyB3aXRoIGludHJvZHVjZWQgc3BlY2llcyAoMC40OcKxMC4zMCkgYW5kIHRob3NlIHdpdGhvdXQgKDAuNznCsTAuMjEpIChwIDwgMC4wMDAxKQoKCiMgRXhhbWluZSBpbmRpdmlkdWFsIG1ldHJpY3MKCiMjIEFuYWx5c2lzIGRhdGEgZnJhbWUKYGBge3J9Cmdlb2dyYXBoeSA9IHJlYWRfY3N2KGZpbGVuYW1lKENJVFlfREFUQV9PVVRQVVRfRElSLCAnZ2VvZ3JhcGh5LmNzdicpKQpuYW1lcyhnZW9ncmFwaHkpCmBgYAoKYGBge3J9CmFuYWx5c2lzX2RhdGEgPSBjb21tdW5pdHlfZGF0YV93aXRoX3JlYWxtWyxjKCdjaXR5X2lkJywgJ21udGRfbm9ybWFsaXNlZCcsICdtYXNzX2ZkaXZfbm9ybWFsaXNlZCcsICdnYXBlX3dpZHRoX2ZkaXZfbm9ybWFsaXNlZCcsICdoYW5kd2luZ19pbmRleF9mZGl2X25vcm1hbGlzZWQnLCAnY29yZV9yZWFsbScpXSAlPiUgCiAgbGVmdF9qb2luKGNpdHlfcG9pbnRzWyxjKCdjaXR5X2lkJywgJ2xhdGl0dWRlJywgJ2xvbmdpdHVkZScpXSkgJT4lCiAgbGVmdF9qb2luKGNvbW11bml0eV9kYXRhX3dpdGhfaW50cm9kdWN0aW9uc1ssYygnY2l0eV9pZCcsICdoYXNfaW50cm9kdWNlZF9zcGVjaWVzJyldKSAlPiUKICBsZWZ0X2pvaW4oZ2VvZ3JhcGh5KQoKYW5hbHlzaXNfZGF0YSRhYnNfbGF0aXR1ZGUgPSBhYnMoYW5hbHlzaXNfZGF0YSRsYXRpdHVkZSkKYW5hbHlzaXNfZGF0YSRjb3JlX3JlYWxtID0gZmFjdG9yKGFuYWx5c2lzX2RhdGEkY29yZV9yZWFsbSwgbGV2ZWxzID0gYygnUGFsZWFyY3RpYycsICdOZWFyY3RpYycsICdOZW90cm9waWMnLCAnQWZyb3Ryb3BpYycsICdJbmRvbWFsYXlhbicsICdBdXN0cmFsYXNpYScsICdPY2VhbmlhJykpCmFuYWx5c2lzX2RhdGEkaGFzX2ludHJvZHVjZWRfc3BlY2llcyA9IGZhY3RvcihhbmFseXNpc19kYXRhJGhhc19pbnRyb2R1Y2VkX3NwZWNpZXMsIGxldmVsID0gYygnVFJVRScsICdGQUxTRScpLCBsYWJlbHMgPSBjKCdJbnRyb2R1Y2VkIHNwZWNpZXMnLCAnTm8gaW50cm9kdWNlZCBzcGVjaWVzJykpCmBgYAoKYGBge3J9Cm1vZGVsX2RhdGEgPSBmdW5jdGlvbihkZiwgZGVwZW5kYW50X3ZhcikgewogIGRmWyxjKGRlcGVuZGFudF92YXIsICdjb3JlX3JlYWxtJywgJ2Fic19sYXRpdHVkZScsICdsYXRpdHVkZScsICdsb25naXR1ZGUnLCAnaGFzX2ludHJvZHVjZWRfc3BlY2llcycsICdjaXR5X2F2Z19uZHZpJywgJ2NpdHlfYXZnX2VsZXZhdGlvbicsICdjaXR5X2F2Z190ZW1wJywgJ2NpdHlfYXZnX21pbl9tb250aGx5X3RlbXAnLCAnY2l0eV9hdmdfbWF4X21vbnRobHlfdGVtcCcsICdjaXR5X2F2Z19tb250aGx5X3RlbXAnLCAnY2l0eV9hdmdfcmFpbmZhbGwnLCAnY2l0eV9hdmdfbWF4X21vbnRobHlfcmFpbmZhbGwnLCAnY2l0eV9hdmdfbWluX21vbnRobHlfcmFpbmZhbGwnLCAnY2l0eV9hdmdfc29pbF9tb2lzdHVyZScsICdjaXR5X21heF9lbGV2JywgJ2NpdHlfbWluX2VsZXYnLCAnY2l0eV9lbGV2X3JhbmdlJywgJ3JlZ2lvbl8yMGttX2F2Z19uZHZpJywgJ3JlZ2lvbl8yMGttX2F2Z19lbGV2YXRpb24nLCAncmVnaW9uXzIwa21fYXZnX3NvaWxfbW9pc3R1cmUnLCAncmVnaW9uXzIwa21fbWF4X2VsZXYnLCAncmVnaW9uXzIwa21fbWluX2VsZXYnLCAncmVnaW9uXzIwa21fZWxldl9yYW5nZScsICdyZWdpb25fNTBrbV9hdmdfbmR2aScsICdyZWdpb25fNTBrbV9hdmdfZWxldmF0aW9uJywgJ3JlZ2lvbl81MGttX2F2Z19zb2lsX21vaXN0dXJlJywgJ3JlZ2lvbl81MGttX21heF9lbGV2JywgJ3JlZ2lvbl81MGttX21pbl9lbGV2JywgJ3JlZ2lvbl81MGttX2VsZXZfcmFuZ2UnKV0KfQptb2RlbF9kYXRhKGFuYWx5c2lzX2RhdGEsICdtbnRkX25vcm1hbGlzZWQnKQpgYGAKCmBgYHtyfQpuYW1lcyhhbmFseXNpc19kYXRhKQpgYGAKCmBgYHtyfQphbGxfZXhwbGFuYXRvcmllcyA9IGMoCiAgICAnYWJzX2xhdGl0dWRlJywgJ2xhdGl0dWRlJywgJ2xvbmdpdHVkZScsIAogICAgJ2hhc19pbnRyb2R1Y2VkX3NwZWNpZXMnLAogICAgJ2NpdHlfYXZnX25kdmknLCAnY2l0eV9hdmdfZWxldmF0aW9uJywgJ2NpdHlfYXZnX3RlbXAnLCAnY2l0eV9hdmdfbWluX21vbnRobHlfdGVtcCcsICdjaXR5X2F2Z19tYXhfbW9udGhseV90ZW1wJywgCiAgICAnY2l0eV9hdmdfbW9udGhseV90ZW1wJywgJ2NpdHlfYXZnX3JhaW5mYWxsJywgJ2NpdHlfYXZnX21heF9tb250aGx5X3JhaW5mYWxsJywgJ2NpdHlfYXZnX21pbl9tb250aGx5X3JhaW5mYWxsJywgCiAgICAnY2l0eV9hdmdfc29pbF9tb2lzdHVyZScsICdjaXR5X21heF9lbGV2JywgJ2NpdHlfbWluX2VsZXYnLCAnY2l0eV9lbGV2X3JhbmdlJywKICAgICdyZWdpb25fMjBrbV9hdmdfbmR2aScsICdyZWdpb25fMjBrbV9hdmdfZWxldmF0aW9uJywgJ3JlZ2lvbl8yMGttX2F2Z19zb2lsX21vaXN0dXJlJywgJ3JlZ2lvbl8yMGttX21heF9lbGV2JywgCiAgICAncmVnaW9uXzIwa21fbWluX2VsZXYnLCAncmVnaW9uXzIwa21fZWxldl9yYW5nZScsCiAgICAncmVnaW9uXzUwa21fYXZnX25kdmknLCAncmVnaW9uXzUwa21fYXZnX2VsZXZhdGlvbicsICdyZWdpb25fNTBrbV9hdmdfc29pbF9tb2lzdHVyZScsICdyZWdpb25fNTBrbV9tYXhfZWxldicsIAogICAgJ3JlZ2lvbl81MGttX21pbl9lbGV2JywgJ3JlZ2lvbl81MGttX2VsZXZfcmFuZ2UnLAogICAgJ2NvcmVfcmVhbG1BZnJvdHJvcGljJywgJ2NvcmVfcmVhbG1BdXN0cmFsYXNpYScsICdjb3JlX3JlYWxtSW5kb21hbGF5YW4nLCAnY29yZV9yZWFsbU5lYXJjdGljJywgJ2NvcmVfcmVhbG1OZW90cm9waWMnLCAnY29yZV9yZWFsbVBhbGVhcmN0aWMnKQoKdHlwZV9sYWJlbHMgPSBmdW5jdGlvbihwKSB7CiAgZXhwbGFuYXRvcnlfbGV2ZWxzID0gYWxsX2V4cGxhbmF0b3JpZXNbYWxsX2V4cGxhbmF0b3JpZXMgJWluJSBwJGV4cGxhbmF0b3J5XQogIHAkZXhwbGFuYXRvcnkgPC0gZmFjdG9yKHAkZXhwbGFuYXRvcnksIGxldmVscyA9IGV4cGxhbmF0b3J5X2xldmVscykKICAKICBwJHR5cGUgPC0gJ1JlYWxtJwogIHAkdHlwZVtwJGV4cGxhbmF0b3J5ICVpbiUgYygnY2l0eV9hdmdfbmR2aScsICdjaXR5X2F2Z19lbGV2YXRpb24nLCAnY2l0eV9hdmdfdGVtcCcsICdjaXR5X2F2Z19taW5fbW9udGhseV90ZW1wJywgJ2NpdHlfYXZnX21heF9tb250aGx5X3RlbXAnLCAKICAgICdjaXR5X2F2Z19tb250aGx5X3RlbXAnLCAnY2l0eV9hdmdfcmFpbmZhbGwnLCAnY2l0eV9hdmdfbWF4X21vbnRobHlfcmFpbmZhbGwnLCAnY2l0eV9hdmdfbWluX21vbnRobHlfcmFpbmZhbGwnLCAKICAgICdjaXR5X2F2Z19zb2lsX21vaXN0dXJlJywgJ2NpdHlfbWF4X2VsZXYnLCAnY2l0eV9taW5fZWxldicsICdjaXR5X2VsZXZfcmFuZ2UnKV0gPC0gJ0NpdHkgZ2VvZ3JhcGh5JwogIHAkdHlwZVtwJGV4cGxhbmF0b3J5ICVpbiUgYygncmVnaW9uXzUwa21fYXZnX25kdmknLCAncmVnaW9uXzUwa21fYXZnX2VsZXZhdGlvbicsICdyZWdpb25fNTBrbV9hdmdfc29pbF9tb2lzdHVyZScsICdyZWdpb25fNTBrbV9tYXhfZWxldicsIAogICAgJ3JlZ2lvbl81MGttX21pbl9lbGV2JywgJ3JlZ2lvbl81MGttX2VsZXZfcmFuZ2UnKV0gPC0gJ1JlZ2lvbmFsICg1MGttKSBnZW9ncmFwaHknCiAgIHAkdHlwZVtwJGV4cGxhbmF0b3J5ICVpbiUgYygncmVnaW9uXzIwa21fYXZnX25kdmknLCAncmVnaW9uXzIwa21fYXZnX2VsZXZhdGlvbicsICdyZWdpb25fMjBrbV9hdmdfc29pbF9tb2lzdHVyZScsICdyZWdpb25fMjBrbV9tYXhfZWxldicsIAogICAgJ3JlZ2lvbl8yMGttX21pbl9lbGV2JywgJ3JlZ2lvbl8yMGttX2VsZXZfcmFuZ2UnKV0gPC0gJ1JlZ2lvbmFsICgyMGttKSBnZW9ncmFwaHknCiAgcCR0eXBlW3AkZXhwbGFuYXRvcnkgJWluJSBjKCdhYnNfbGF0aXR1ZGUnLCAnbGF0aXR1ZGUnLCAnbG9uZ2l0dWRlJyldIDwtICdTcGF0aWFsJwogIHAKfQpgYGAKCmBgYHtyfQpleHBsYW5hdG9yeV9sYWJlbHMgPSBjKAogICdoYXNfaW50cm9kdWNlZF9zcGVjaWVzJz0nSGFzIGludHJvZHVjZWQgc3BlY2llcycsIAogICdjaXR5X2F2Z19uZHZpJz0nQXZlcmFnZSBORFZJJywgCiAgJ2NpdHlfYXZnX2VsZXZhdGlvbic9J0F2ZXJhZ2UgZWxldmF0aW9uJywgCiAgJ2NpdHlfYXZnX3RlbXAnPSdBdmVyYWdlIHRlbXBlcmF0dXJlJywgCiAgJ2NpdHlfYXZnX21pbl9tb250aGx5X3RlbXAnPSdBdmVyYWdlIG1pbmltdW0gbW9udGhseSB0ZW1wZXJhdHVyZScsIAogICdjaXR5X2F2Z19tYXhfbW9udGhseV90ZW1wJz0nQXZlcmFnZSBtYXhpbXVtIG1vbnRobHkgdGVtcGVyYXR1cmUnLCAKICAnY2l0eV9hdmdfbW9udGhseV90ZW1wJz0nQXZlcmFnZSBtb250aGx5IHRlbXBlcmF0dXJlJywgCiAgJ2NpdHlfYXZnX3JhaW5mYWxsJz0nQXZlcmFnZSByYWluZmFsbCcsIAogICdjaXR5X2F2Z19tYXhfbW9udGhseV9yYWluZmFsbCc9J0F2ZXJhZ2UgbWF4aW11bSBtb250aGx5IHJhaW5mYWxsJywgCiAgJ2NpdHlfYXZnX21pbl9tb250aGx5X3JhaW5mYWxsJz0nQXZlcmFnZSBtaW5pbXVtIG1vbnRobHkgcmFpbmZhbGwnLCAKICAnY2l0eV9hdmdfc29pbF9tb2lzdHVyZSc9J0F2ZXJhZ2Ugc29pbCBtb2lzdHVyZScsIAogICdjaXR5X21heF9lbGV2Jz0nTWF4aW11bSBlbGV2YXRpb24nLCAKICAnY2l0eV9taW5fZWxldic9J01pbmltdW0gZWxldmF0aW9uJywgCiAgJ2NpdHlfZWxldl9yYW5nZSc9J0VsZXZhdGlvbiByYW5nZScsIAogICdyZWdpb25fMjBrbV9hdmdfbmR2aSc9J0F2ZXJhZ2UgTkRWSScsIAogICdyZWdpb25fMjBrbV9hdmdfZWxldmF0aW9uJz0nQXZlcmFnZSBlbGV2YXRpb24nLCAKICAncmVnaW9uXzIwa21fYXZnX3NvaWxfbW9pc3R1cmUnPSdBdmVyYWdlIHNvaWwgbW9pc3R1cmUnLCAKICAncmVnaW9uXzIwa21fbWF4X2VsZXYnPSdNYXhpbXVtIGVsZXZhdGlvbicsIAogICdyZWdpb25fMjBrbV9taW5fZWxldic9J01pbmltdW0gZWxldmF0aW9uJywKICAncmVnaW9uXzIwa21fZWxldl9yYW5nZSc9J0VsZXZhdGlvbiByYW5nZScsCiAgJ3JlZ2lvbl81MGttX2F2Z19uZHZpJz0nQXZlcmFnZSBORFZJJywKICAncmVnaW9uXzUwa21fYXZnX2VsZXZhdGlvbic9J0F2ZXJhZ2UgZWxldmF0aW9uJywKICAncmVnaW9uXzUwa21fYXZnX3NvaWxfbW9pc3R1cmUnPSdBdmVyYWdlIHNvaWwgbW9pc3R1cmUnLCAKICAncmVnaW9uXzUwa21fbWF4X2VsZXYnPSdNYXhpbXVtIGVsZXZhdGlvbicsCiAgJ3JlZ2lvbl81MGttX21pbl9lbGV2Jz0nTWluaW11bSBlbGV2YXRpb24nLCAKICAncmVnaW9uXzUwa21fZWxldl9yYW5nZSc9J0VsZXZhdGlvbiByYW5nZScsCiAgJ2Fic19sYXRpdHVkZScgPSAnQWJzb2x1dGUgbGF0aXR1ZGUnLAogICdsYXRpdHVkZScgPSAnTGF0aXR1ZGUnLAogICdsb25naXR1ZGUnID0gJ0xvbmdpdHVkZScsCiAgJ2NvcmVfcmVhbG1BZnJvdHJvcGljJyA9ICdBZnJvdHJvcGljYWwnLCAKICAnY29yZV9yZWFsbUF1c3RyYWxhc2lhJyA9ICdBdXN0YWxpYXNpYW4nLCAKICAnY29yZV9yZWFsbUluZG9tYWxheWFuJyA9ICdJbmRvbWFsYXlhbicsIAogICdjb3JlX3JlYWxtTmVhcmN0aWMnID0gJ05lYXJjdGljJywgCiAgJ2NvcmVfcmVhbG1OZW90cm9waWMnID0gJ05lb3Ryb3BpY2FsJywKICAnY29yZV9yZWFsbVBhbGVhcmN0aWMnID0gJ1BhbGVhcmN0aWMnLAogICdjb3JlX3JlYWxtT2NlYW5pYScgPSAnT2NlYW5pY2FsJykKYGBgCgojIyBIZWxwZXIgcGxvdCBmdW5jdGlvbnMKYGBge3J9Cmdlb21fbm9ybWFsaXNlZF9oaXN0b2dyYW0gPSBmdW5jdGlvbihuYW1lLCBnZywgbGVnZW5kLnBvc2l0aW9uID0gImJvdHRvbSIpIHsKICBnZyArIAogICAgZ2VvbV9oaXN0b2dyYW0oYWVzKGZpbGwgPSBjb3JlX3JlYWxtKSwgYmlud2lkdGggPSAwLjEsIHBvc2l0aW9uID0gImRvZGdlIikgKwogICAgZ2VvbV92bGluZShhZXMoeGludGVyY2VwdCA9IDAuNSksIGNvbG9yID0gIiMwMDAwMDAiLCBzaXplID0gMC40KSArCiAgICBnZW9tX3ZsaW5lKGFlcyh4aW50ZXJjZXB0ID0gMCksIGNvbG9yID0gIiMwMDAwMDAiLCBzaXplID0gMC4yLCBsaW5ldHlwZSA9ICJkYXNoZWQiKSArCiAgICBnZW9tX3ZsaW5lKGFlcyh4aW50ZXJjZXB0ID0gMSksIGNvbG9yID0gIiMwMDAwMDAiLCBzaXplID0gMC4yLCBsaW5ldHlwZSA9ICJkYXNoZWQiKSArIAogICAgeWxhYigiTnVtYmVyIG9mIGNpdGllcyIpICsgeGxhYigiTm9ybWFsaXNlZCBSZXNwb25zZSIpICsgeWxpbShjKDAsIDcwKSkgKwogICAgbGFicyh0aXRsZSA9IG5hbWUsIGZpbGwgPSAnUmVhbG0nKSArCiAgICB0aGVtZV9idygpICsKICAgIHRoZW1lKGxlZ2VuZC5wb3NpdGlvbj1sZWdlbmQucG9zaXRpb24pCn0KYGBgCgpgYGB7cn0KZ2VvbV9tYXAgPSBmdW5jdGlvbihtYXBfc2YsIHRpdGxlKSB7CiAgbm9ybV9tbnRkX2FuYWx5c2lzX2dlbyA9IGdncGxvdCgpICsgCiAgICBnZW9tX3NmKGRhdGEgPSB3b3JsZF9tYXAsIGFlcyhnZW9tZXRyeSA9IGdlb21ldHJ5KSkgKwogICAgbWFwX3NmICsKICAgIG5vcm1hbGlzZWRfY29sb3Vyc19zY2FsZSArCiAgICBsYWJzKGNvbG91ciA9ICdOb3JtYWxpc2VkXG5SZXNwb25zZScpICsKICAgIHRoZW1lX2J3KCkgKwogICAgdGhlbWUobGVnZW5kLnBvc2l0aW9uPSJib3R0b20iKQp9CmBgYAoKIyMgSGVscGVyIERyZWRnZSBmdW5jdGlvbnMKYGBge3J9CiMgVGFrZW4gZnJvbSBNdU1JTiBwYWNrYWdlCiMgaHR0cHM6Ly9yZHJyLmlvL2NyYW4vTXVNSW4vc3JjL1IvYXZlcmFnaW5nLlIKIyBodHRwczovL3JkcnIuaW8vY3Jhbi9NdU1Jbi9zcmMvUi9tb2RlbC5hdmcuUgoKLmNvZWZhcnIuYXZnIDwtCiAgZnVuY3Rpb24oY2ZhcnIsIHdlaWdodCwgcmV2aXNlZC52YXIsIGZ1bGwsIGFscGhhKSB7CQogICAgd2VpZ2h0IDwtIHdlaWdodCAvIHN1bSh3ZWlnaHQpCiAgICBuQ29lZiA8LSBkaW0oY2ZhcnIpWzNMXQogICAgaWYoZnVsbCkgewogICAgICBuYXMgPC0gaXMubmEoY2ZhcnJbLCAxTCwgXSkgJiBpcy5uYShjZmFyclssIDJMLCBdKQogICAgICBjZmFyclssIDFMLCBdW25hc10gPC0gY2ZhcnJbLCAyTCwgXVtuYXNdIDwtIDAKICAgICAgI2NmYXJyWywgMUw6MkwsIF1baXMubmEoY2ZhcnJbLCAxTDoyTCwgXSldIDwtIDAKICAgICAgaWYoIWFsbChpcy5uYShjZmFyclssIDNMLCBdKSkpCiAgICAgICAgY2ZhcnJbICwzTCwgXVtpcy5uYShjZmFyclsgLCAzTCwgXSldIDwtIEluZgogICAgfQogICAgCiAgICBhdmdjb2VmIDwtIGFycmF5KGRpbSA9IGMobkNvZWYsIDVMKSwKICAgICAgICAgICAgICAgICAgICAgZGltbmFtZXMgPSBsaXN0KGRpbW5hbWVzKGNmYXJyKVtbM0xdXSwgYygiRXN0aW1hdGUiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICJTdGQuIEVycm9yIiwgIkFkanVzdGVkIFNFIiwgIkxvd2VyIENJIiwgIlVwcGVyIENJIikpKQogICAgZm9yKGkgaW4gc2VxX2xlbihuQ29lZikpCiAgICAgIGF2Z2NvZWZbaSwgXSA8LSBwYXIuYXZnKGNmYXJyWywgMUwsIGldLCBjZmFyclssIDJMLCBpXSwgd2VpZ2h0LAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICBkZiA9IGNmYXJyWywgM0wsIGldLCBhbHBoYSA9IGFscGhhLCByZXZpc2VkLnZhciA9IHJldmlzZWQudmFyKQogICAgCiAgICBhdmdjb2VmW2lzLm5hbihhdmdjb2VmKV0gPC0gTkEKICAgIHJldHVybihhdmdjb2VmKQogIH0KCi5tYWtlY29lZm1hdCA8LSBmdW5jdGlvbihjZikgewogIG5vLmFzZSA8LSBhbGwoaXMubmEoY2ZbLCAzTF0pKQogIHogPC0gYWJzKGNmWywgMUxdIC8gY2ZbLCBpZihuby5hc2UpIDJMIGVsc2UgM0xdKQogIHB2YWwgPC0gMiAqIHBub3JtKHosIGxvd2VyLnRhaWwgPSBGQUxTRSkKICBjYmluZChjZlssIGlmKG5vLmFzZSkgMUw6MkwgZWxzZSAxTDozTCwgZHJvcCA9IEZBTFNFXSwKICAgICAgICBgeiB2YWx1ZWAgPSB6LCBgUHIoPnx6fClgID0gemFwc21hbGwocHZhbCkpCn0KCiMgR2VuZXJhdGUgbW9kZWwgc2VsZWN0aW9ucyB1c2luZyBsbWVyLCBkcmVkZ2UsIGFuZCBtb2RlbC5hdmcKIyBgZm9ydW1sYWAgOiBhIHR3by1zaWRlZCBsaW5lYXIgZm9ybXVsYSBvYmplY3QgZGVzY3JpYmluZyBib3RoIHRoZSBmaXhlZC1lZmZlY3RzIGFuZCByYW5kb20tZWZmZWN0cyBwYXJ0IG9mIHRoZSBtb2RlbAojIGBkYXRhYCA6IHRoZSBkYXRhIGZyYW1lIGNvbnRhaW5pbmcgdGhlIHZhcmlhYmxlcyBmcm9tIHRoZSBmb3JtdWxhCiMgYGFpY19kZWx0YWAgOiB0aGUgQUlDIGRlbHRhIHRvIHVzZSBmb3Igc2VsZWN0aW5nIG1vZGVscyBpbiBtb2RlbCBhdmVyYWdlCm1vZGVsX2F2ZXJhZ2UgPC0gZnVuY3Rpb24oZm9ybXVsYSwgZGF0YSwgYWljX2RlbHRhID0gMjApIHsKICBtb2RlbCA8LSBsbSgKICAgIGZvcm11bGEsCiAgICBkYXRhPWRhdGEKICApCiAgZHJlZGdlX3Jlc3VsdCA8LSBkcmVkZ2UobW9kZWwpCiAgc3VtbWFyeShtb2RlbC5hdmcoZHJlZGdlX3Jlc3VsdCwgc3Vic2V0ID0gZGVsdGEgPCBhaWNfZGVsdGEpKQp9CgojIENyZWF0ZSBhIHN1bW1hcnkgZGF0YSBmcmFtZSBjb250YWluaW5nIHRoZSBzZWxlY3RlZCB2YXJpYWJsZXMgZnJvbSBhIG1vZGVsCiMgYG1vZGVsX3N1bWAgOiBUaGUgbW9kZWwgc3VtbWFyeSBvdXRwdXQgZnJvbSBgbW9kZWxfYXZlcmFnZWAKbW9kZWxfc3VtbWFyeSA8LSBmdW5jdGlvbihtb2RlbF9zdW0pIHsKICAuY29sdW1uX25hbWUgPC0gZnVuY3Rpb24ocG9zdGZpeCkgewogICAgcG9zdGZpeAogIH0KICAKICAjIGp1c3QgcmV0dXJuIHRoZSBlc3RpbWF0ZSBhbmQgcCB2YWx1ZQogIHdlaWdodCA8LSBtb2RlbF9zdW0kbXNUYWJsZVssIDVMXQogIAogIGNvZWZtYXQuZnVsbCA8LSBhcy5kYXRhLmZyYW1lKC5tYWtlY29lZm1hdCguY29lZmFyci5hdmcobW9kZWxfc3VtJGNvZWZBcnJheSwgd2VpZ2h0LAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgYXR0cihtb2RlbF9zdW0sICJyZXZpc2VkLnZhciIpLCBUUlVFLCAwLjA1KSkpCiAgCiAgY29lZm1hdC5zdWJzZXQgPC0KICAgIGFzLmRhdGEuZnJhbWUoLm1ha2Vjb2VmbWF0KC5jb2VmYXJyLmF2Zyhtb2RlbF9zdW0kY29lZkFycmF5LCB3ZWlnaHQsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgYXR0cihtb2RlbF9zdW0sICJyZXZpc2VkLnZhciIpLCBGQUxTRSwgMC4wNSkpKQogIAogIAogIGNvZWZtYXQuc3Vic2V0IDwtIGNvZWZtYXQuc3Vic2V0Wy1jKDEpLCBjKDEsIDIsIDUpXQogIG5hbWVzKGNvZWZtYXQuc3Vic2V0KSA8LSBjKC5jb2x1bW5fbmFtZSgiZXN0aW1hdGUiKSwgLmNvbHVtbl9uYW1lKCJlcnJvciIpLCAuY29sdW1uX25hbWUoInAiKSkKICBjb2VmbWF0LnN1YnNldCA8LSB0aWJibGU6OnJvd25hbWVzX3RvX2NvbHVtbihjb2VmbWF0LnN1YnNldCwgImV4cGxhbmF0b3J5IikKICBjb2VmbWF0LnN1YnNldCRtb2RlbCA9ICdzdWJzZXQnCiAgCiAgY29lZm1hdC5mdWxsIDwtIGNvZWZtYXQuZnVsbFstYygxKSwgYygxLCAyLCA1KV0KICBuYW1lcyhjb2VmbWF0LmZ1bGwpIDwtIGMoLmNvbHVtbl9uYW1lKCJlc3RpbWF0ZSIpLCAuY29sdW1uX25hbWUoImVycm9yIiksIC5jb2x1bW5fbmFtZSgicCIpKQogIGNvZWZtYXQuZnVsbCA8LSB0aWJibGU6OnJvd25hbWVzX3RvX2NvbHVtbihjb2VmbWF0LmZ1bGwsICJleHBsYW5hdG9yeSIpCiAgY29lZm1hdC5mdWxsJG1vZGVsID0gJ2Z1bGwnCiAgCiAgcmJpbmQoY29lZm1hdC5mdWxsLCBjb2VmbWF0LnN1YnNldCkKfQpgYGAKCmBgYHtyfQpmb3JtdWxhX2Zyb21fdnN1cnAgPSBmdW5jdGlvbihwcmVkaWN0b3JzLCBkZXBlbmRlbnQsIHZzdXJwX3Jlc3VsdCkgewogIGFzLmZvcm11bGEocGFzdGUoZGVwZW5kZW50LCBwYXN0ZShuYW1lcyhwcmVkaWN0b3JzWyx2c3VycF9yZXN1bHQkdmFyc2VsZWN0LmludGVycF0pLCBjb2xsYXBzZT0iKyIpLCBzZXAgPSAifiIpKQp9CmBgYAoKYGBge3J9CnBsb3RfdnN1cnBfcmVzdWx0ID0gZnVuY3Rpb24ocmVzdWx0X3RhYmxlKSB7CiAgcGxvdCA9IHJlc3VsdF90YWJsZVtyZXN1bHRfdGFibGUkbW9kZWwgPT0gJ2Z1bGwnLF0KICBwbG90ID0gdHlwZV9sYWJlbHMocGxvdCkKCiAgZ2dwbG90KHBsb3QsIGFlcyh5PWV4cGxhbmF0b3J5LCB4PWVzdGltYXRlLCBjb2xvdXIgPSB0eXBlKSkgKyAKICAgIGdlb21fbGluZSgpICsKICAgIGdlb21fcG9pbnQoKSsKICAgIGdlb21fZXJyb3JiYXIoYWVzKHhtaW49ZXN0aW1hdGUtZXJyb3IsIHhtYXg9ZXN0aW1hdGUrZXJyb3IpLCB3aWR0aD0uMiwKICAgICAgICAgICAgICAgICAgIHBvc2l0aW9uPXBvc2l0aW9uX2RvZGdlKDAuMDUpKSArCiAgICBzY2FsZV95X2Rpc2NyZXRlKAogICAgICBsaW1pdHMgPSByZXYobGV2ZWxzKHBsb3QkZXhwbGFuYXRvcnkpKSwgCiAgICAgIGxhYmVscyA9IGV4cGxhbmF0b3J5X2xhYmVscykgKwogICAgdGhlbWVfYncoKSArCiAgICBnZW9tX3ZsaW5lKHhpbnRlcmNlcHQ9MCwgbGluZXR5cGU9ImRvdHRlZCIpICsKICAgIGd1aWRlcyhjb2xvdXI9Z3VpZGVfbGVnZW5kKHRpdGxlPSJQcmVkaWN0b3IgdHlwZSIpKSArIHhsYWIoJ0luY3JlYXNlIGZyb20gMCAoaGFiaXRhdCBmaWx0ZXJpbmcpXG50byAxIChjb21wZXRpdGl2ZSBleGNsdXNpb24pXG7CsSBTdGFuZGFyZCBFcnJvcicpICsgeWxhYignUHJlZGljdG9yJykgKwogICAgdGhlbWUobGVnZW5kLmp1c3RpZmljYXRpb24gPSAidG9wIikKfQpgYGAKCiMjIE1OVEQKYGBge3J9Cm5vcm1fbW50ZF9hbmFseXNpc19wbG90ID0gZ2VvbV9ub3JtYWxpc2VkX2hpc3RvZ3JhbSgKICAnTU5URCcsIAogIGdncGxvdChhbmFseXNpc19kYXRhLCBhZXMobW50ZF9ub3JtYWxpc2VkKSkKKQpub3JtX21udGRfYW5hbHlzaXNfcGxvdApgYGAKCmBgYHtyfQpub3JtX21udGRfYW5hbHlzaXNfZ2VvX3Bsb3QgPSBnZW9tX21hcChnZW9tX3NmKGRhdGEgPSBhbmFseXNpc19kYXRhLCBhZXMoY29sb3IgPSBtbnRkX25vcm1hbGlzZWQsIGdlb21ldHJ5ID0gZ2VvbWV0cnkpKSwgJ01OVEQnKQpub3JtX21udGRfYW5hbHlzaXNfZ2VvX3Bsb3QKZ2dzYXZlKGZpbGVuYW1lKEZJR1VSRVNfT1VUUFVUX0RJUiwgJ25vcm1hbGlzZWRfbW50ZF91c2luZ19hYnVuZGFuY2UuanBnJyksIHdpZHRoID0gMjUwMCwgaGVpZ2h0PTExMDAsIHVuaXRzID0gJ3B4JykKYGBgCgpgYGB7cn0Kbm9ybV9tbnRkX2FuYWx5c2lzX2RhdGEgPSBtb2RlbF9kYXRhKGFuYWx5c2lzX2RhdGFbIWlzLm5hKGFuYWx5c2lzX2RhdGEkbW50ZF9ub3JtYWxpc2VkKSxdLCAnbW50ZF9ub3JtYWxpc2VkJykKbm9ybV9tbnRkX2FuYWx5c2lzX3ByZWRpY3RvcnMgPSBub3JtX21udGRfYW5hbHlzaXNfZGF0YVssLTFdCm5vcm1fbW50ZF9hbmFseXNpc19pbnRlcnAgPSBWU1VSRih4ID0gbm9ybV9tbnRkX2FuYWx5c2lzX3ByZWRpY3RvcnMsIHkgPSBub3JtX21udGRfYW5hbHlzaXNfZGF0YSRtbnRkX25vcm1hbGlzZWQpCm5hbWVzKG5vcm1fbW50ZF9hbmFseXNpc19wcmVkaWN0b3JzWyxub3JtX21udGRfYW5hbHlzaXNfaW50ZXJwJHZhcnNlbGVjdC5pbnRlcnBdKQpgYGAKCmBgYHtyfQpub3JtX21udGRfYW5hbHlzaXNfZm9ybXVsYSA9IGZvcm11bGFfZnJvbV92c3VycChub3JtX21udGRfYW5hbHlzaXNfcHJlZGljdG9ycywgIm1udGRfbm9ybWFsaXNlZCIsIG5vcm1fbW50ZF9hbmFseXNpc19pbnRlcnApCm5vcm1fbW50ZF9hbmFseXNpc19yZXN1bHQgPC0gbW9kZWxfYXZlcmFnZShub3JtX21udGRfYW5hbHlzaXNfZm9ybXVsYSwgbm9ybV9tbnRkX2FuYWx5c2lzX2RhdGEpCm5vcm1fbW50ZF9hbmFseXNpc19yZXN1bHRfdGFibGUgPSBtb2RlbF9zdW1tYXJ5KG5vcm1fbW50ZF9hbmFseXNpc19yZXN1bHQpCm5vcm1fbW50ZF9hbmFseXNpc19yZXN1bHRfdGFibGUKYGBgCgpgYGB7cn0Kbm9ybV9tbnRkX2FuYWx5c2lzX3ByZWRfcGxvdCA9IHBsb3RfdnN1cnBfcmVzdWx0KG5vcm1fbW50ZF9hbmFseXNpc19yZXN1bHRfdGFibGUpCm5vcm1fbW50ZF9hbmFseXNpc19wcmVkX3Bsb3QKYGBgCgojIyBHYXBlIHdpZHRoIC0gRkRpdgpgYGB7cn0Kbm9ybV9nYXBlX2ZkaXZfYW5hbHlzaXNfcGxvdCA9IGdlb21fbm9ybWFsaXNlZF9oaXN0b2dyYW0oCiAgJ0dhcGUgRkRpdicsIAogIGdncGxvdChhbmFseXNpc19kYXRhLCBhZXMoZ2FwZV93aWR0aF9mZGl2X25vcm1hbGlzZWQpKQopCm5vcm1fZ2FwZV9mZGl2X2FuYWx5c2lzX3Bsb3QKYGBgCgpgYGB7cn0Kbm9ybV9nYXBlX2ZkaXZfYW5hbHlzaXNfZ2VvX3Bsb3QgPSBnZW9tX21hcChnZW9tX3NmKGRhdGEgPSBhbmFseXNpc19kYXRhLCBhZXMoY29sb3IgPSBnYXBlX3dpZHRoX2ZkaXZfbm9ybWFsaXNlZCwgZ2VvbWV0cnkgPSBnZW9tZXRyeSkpLCAnR2FwZSBXaWR0aCBGRGl2JykKbm9ybV9nYXBlX2ZkaXZfYW5hbHlzaXNfZ2VvX3Bsb3QKZ2dzYXZlKGZpbGVuYW1lKEZJR1VSRVNfT1VUUFVUX0RJUiwgJ25vcm1hbGlzZWRfZ2FwZV93aWR0aF91c2luZ19hYnVuZGFuY2UuanBnJyksIHdpZHRoID0gMjUwMCwgaGVpZ2h0PTExMDAsIHVuaXRzID0gJ3B4JykKYGBgCgpgYGB7cn0Kbm9ybV9nYXBlX2ZkaXZfYW5hbHlzaXNfZGF0YSA9IG1vZGVsX2RhdGEoYW5hbHlzaXNfZGF0YVshaXMubmEoYW5hbHlzaXNfZGF0YSRnYXBlX3dpZHRoX2ZkaXZfbm9ybWFsaXNlZCksXSwgJ2dhcGVfd2lkdGhfZmRpdl9ub3JtYWxpc2VkJykKbm9ybV9nYXBlX2ZkaXZfYW5hbHlzaXNfcHJlZGljdG9ycyA9IG5vcm1fZ2FwZV9mZGl2X2FuYWx5c2lzX2RhdGFbLC0xXQpub3JtX2dhcGVfZmRpdl9hbmFseXNpc19pbnRlcnAgPSBWU1VSRih4ID0gbm9ybV9nYXBlX2ZkaXZfYW5hbHlzaXNfcHJlZGljdG9ycywgeSA9IG5vcm1fZ2FwZV9mZGl2X2FuYWx5c2lzX2RhdGEkZ2FwZV93aWR0aF9mZGl2X25vcm1hbGlzZWQpCm5hbWVzKG5vcm1fZ2FwZV9mZGl2X2FuYWx5c2lzX3ByZWRpY3RvcnNbLG5vcm1fZ2FwZV9mZGl2X2FuYWx5c2lzX2ludGVycCR2YXJzZWxlY3QuaW50ZXJwXSkKYGBgCgpgYGB7cn0Kbm9ybV9nYXBlX2ZkaXZfYW5hbHlzaXNfZm9ybXVsYSA9IGZvcm11bGFfZnJvbV92c3VycChub3JtX2dhcGVfZmRpdl9hbmFseXNpc19wcmVkaWN0b3JzLCAiZ2FwZV93aWR0aF9mZGl2X25vcm1hbGlzZWQiLCBub3JtX2dhcGVfZmRpdl9hbmFseXNpc19pbnRlcnApCm5vcm1fZ2FwZV9mZGl2X2FuYWx5c2lzX3Jlc3VsdCA8LSBtb2RlbF9hdmVyYWdlKG5vcm1fZ2FwZV9mZGl2X2FuYWx5c2lzX2Zvcm11bGEsIG5vcm1fZ2FwZV9mZGl2X2FuYWx5c2lzX2RhdGEpCm5vcm1fZ2FwZV9mZGl2X2FuYWx5c2lzX3Jlc3VsdF90YWJsZSA9IG1vZGVsX3N1bW1hcnkobm9ybV9nYXBlX2ZkaXZfYW5hbHlzaXNfcmVzdWx0KQpub3JtX2dhcGVfZmRpdl9hbmFseXNpc19yZXN1bHRfdGFibGUKYGBgCgpgYGB7cn0Kbm9ybV9nYXBlX2ZkaXZfYW5hbHlzaXNfcHJlZF9wbG90ID0gcGxvdF92c3VycF9yZXN1bHQobm9ybV9nYXBlX2ZkaXZfYW5hbHlzaXNfcmVzdWx0X3RhYmxlKQpub3JtX2dhcGVfZmRpdl9hbmFseXNpc19wcmVkX3Bsb3QKYGBgCgoKIyMgSFdJIC0gRkRpdgpgYGB7cn0Kbm9ybV9od2lfZmRpdl9sb2NvX2FuYWx5c2lzX3Bsb3QgPSBnZW9tX25vcm1hbGlzZWRfaGlzdG9ncmFtKAogICdIV0kgRkRpdicsIAogIGdncGxvdChhbmFseXNpc19kYXRhLCBhZXMoaGFuZHdpbmdfaW5kZXhfZmRpdl9ub3JtYWxpc2VkKSkKKQpub3JtX2h3aV9mZGl2X2xvY29fYW5hbHlzaXNfcGxvdApgYGAKCmBgYHtyfQpub3JtX2h3aV9mZGl2X2FuYWx5c2lzX2dlb19wbG90ID0gZ2VvbV9tYXAoZ2VvbV9zZihkYXRhID0gYW5hbHlzaXNfZGF0YSwgYWVzKGNvbG9yID0gaGFuZHdpbmdfaW5kZXhfZmRpdl9ub3JtYWxpc2VkLCBnZW9tZXRyeSA9IGdlb21ldHJ5KSksICdIV0kgRkRpdicpCm5vcm1faHdpX2ZkaXZfYW5hbHlzaXNfZ2VvX3Bsb3QKZ2dzYXZlKGZpbGVuYW1lKEZJR1VSRVNfT1VUUFVUX0RJUiwgJ25vcm1hbGlzZWRfaHdpX3VzaW5nX2FidW5kYW5jZS5qcGcnKSwgd2lkdGggPSAyNTAwLCBoZWlnaHQ9MTEwMCwgdW5pdHMgPSAncHgnKQpgYGAKCmBgYHtyfQpub3JtX2h3aV9mZGl2X2FuYWx5c2lzX2RhdGEgPSBtb2RlbF9kYXRhKGFuYWx5c2lzX2RhdGFbIWlzLm5hKGFuYWx5c2lzX2RhdGEkaGFuZHdpbmdfaW5kZXhfZmRpdl9ub3JtYWxpc2VkKSxdLCAnaGFuZHdpbmdfaW5kZXhfZmRpdl9ub3JtYWxpc2VkJykKbm9ybV9od2lfZmRpdl9hbmFseXNpc19wcmVkaWN0b3JzID0gbm9ybV9od2lfZmRpdl9hbmFseXNpc19kYXRhWywtMV0Kbm9ybV9od2lfZmRpdl9hbmFseXNpc19pbnRlcnAgPSBWU1VSRih4ID0gbm9ybV9od2lfZmRpdl9hbmFseXNpc19wcmVkaWN0b3JzLCB5ID0gbm9ybV9od2lfZmRpdl9hbmFseXNpc19kYXRhJGhhbmR3aW5nX2luZGV4X2ZkaXZfbm9ybWFsaXNlZCkKbmFtZXMobm9ybV9od2lfZmRpdl9hbmFseXNpc19wcmVkaWN0b3JzWyxub3JtX2h3aV9mZGl2X2FuYWx5c2lzX2ludGVycCR2YXJzZWxlY3QuaW50ZXJwXSkKYGBgCgoKYGBge3J9Cm5vcm1faHdpX2ZkaXZfYW5hbHlzaXNfZm9ybXVsYSA9IGZvcm11bGFfZnJvbV92c3VycChub3JtX2h3aV9mZGl2X2FuYWx5c2lzX3ByZWRpY3RvcnMsICJoYW5kd2luZ19pbmRleF9mZGl2X25vcm1hbGlzZWQiLCBub3JtX2h3aV9mZGl2X2FuYWx5c2lzX2ludGVycCkKbm9ybV9od2lfZmRpdl9hbmFseXNpc19yZXN1bHQgPC0gbW9kZWxfYXZlcmFnZShub3JtX2h3aV9mZGl2X2FuYWx5c2lzX2Zvcm11bGEsIG5vcm1faHdpX2ZkaXZfYW5hbHlzaXNfZGF0YSkKbm9ybV9od2lfZmRpdl9hbmFseXNpc19yZXN1bHRfdGFibGUgPSBtb2RlbF9zdW1tYXJ5KG5vcm1faHdpX2ZkaXZfYW5hbHlzaXNfcmVzdWx0KQpub3JtX2h3aV9mZGl2X2FuYWx5c2lzX3Jlc3VsdF90YWJsZQpgYGAKCmBgYHtyfQpub3JtX2h3aV9mZGl2X2FuYWx5c2lzX3ByZWRfcGxvdCA9IHBsb3RfdnN1cnBfcmVzdWx0KG5vcm1faHdpX2ZkaXZfYW5hbHlzaXNfcmVzdWx0X3RhYmxlKQpub3JtX2h3aV9mZGl2X2FuYWx5c2lzX3ByZWRfcGxvdApgYGAKCgojIyBNYXNzIC0gRkRpdgpgYGB7cn0Kbm9ybV9tYXNzX2ZkaXZfbG9jb19hbmFseXNpc19wbG90ID0gZ2VvbV9ub3JtYWxpc2VkX2hpc3RvZ3JhbSgKICAnTWFzcyBGRGl2JywgCiAgZ2dwbG90KGFuYWx5c2lzX2RhdGEsIGFlcyhtYXNzX2ZkaXZfbm9ybWFsaXNlZCkpCikKbm9ybV9tYXNzX2ZkaXZfbG9jb19hbmFseXNpc19wbG90CmBgYAoKYGBge3J9Cm5vcm1fbWFzc19mZGl2X2FuYWx5c2lzX2dlb19wbG90ID0gZ2VvbV9tYXAoZ2VvbV9zZihkYXRhID0gYW5hbHlzaXNfZGF0YSwgYWVzKGNvbG9yID0gbWFzc19mZGl2X25vcm1hbGlzZWQsIGdlb21ldHJ5ID0gZ2VvbWV0cnkpKSwgJ01hc3MgRkRpdicpCm5vcm1fbWFzc19mZGl2X2FuYWx5c2lzX2dlb19wbG90Cmdnc2F2ZShmaWxlbmFtZShGSUdVUkVTX09VVFBVVF9ESVIsICdub3JtYWxpc2VkX21hc3NfdXNpbmdfYWJ1bmRhbmNlLmpwZycpLCB3aWR0aCA9IDI1MDAsIGhlaWdodD0xMTAwLCB1bml0cyA9ICdweCcpCmBgYAoKYGBge3J9Cm5vcm1fbWFzc19mZGl2X2FuYWx5c2lzX2RhdGEgPSBtb2RlbF9kYXRhKGFuYWx5c2lzX2RhdGFbIWlzLm5hKGFuYWx5c2lzX2RhdGEkbWFzc19mZGl2X25vcm1hbGlzZWQpLF0sICdtYXNzX2ZkaXZfbm9ybWFsaXNlZCcpCm5vcm1fbWFzc19mZGl2X2FuYWx5c2lzX3ByZWRpY3RvcnMgPSBub3JtX21hc3NfZmRpdl9hbmFseXNpc19kYXRhWywtMV0Kbm9ybV9tYXNzX2ZkaXZfYW5hbHlzaXNfaW50ZXJwID0gVlNVUkYoeCA9IG5vcm1fbWFzc19mZGl2X2FuYWx5c2lzX3ByZWRpY3RvcnMsIHkgPSBub3JtX21hc3NfZmRpdl9hbmFseXNpc19kYXRhJG1hc3NfZmRpdl9ub3JtYWxpc2VkKQpuYW1lcyhub3JtX21hc3NfZmRpdl9hbmFseXNpc19wcmVkaWN0b3JzWyxub3JtX21hc3NfZmRpdl9hbmFseXNpc19pbnRlcnAkdmFyc2VsZWN0LmludGVycF0pCmBgYAoKYGBge3J9Cm5vcm1fbWFzc19mZGl2X2FuYWx5c2lzX2Zvcm11bGEgPSBmb3JtdWxhX2Zyb21fdnN1cnAobm9ybV9tYXNzX2ZkaXZfYW5hbHlzaXNfcHJlZGljdG9ycywgIm1hc3NfZmRpdl9ub3JtYWxpc2VkIiwgbm9ybV9tYXNzX2ZkaXZfYW5hbHlzaXNfaW50ZXJwKQpub3JtX21hc3NfZmRpdl9hbmFseXNpc19yZXN1bHQgPC0gbW9kZWxfYXZlcmFnZShub3JtX21hc3NfZmRpdl9hbmFseXNpc19mb3JtdWxhLCBub3JtX21hc3NfZmRpdl9hbmFseXNpc19kYXRhKQpub3JtX21hc3NfZmRpdl9hbmFseXNpc19yZXN1bHRfdGFibGUgPSBtb2RlbF9zdW1tYXJ5KG5vcm1fbWFzc19mZGl2X2FuYWx5c2lzX3Jlc3VsdCkKbm9ybV9tYXNzX2ZkaXZfYW5hbHlzaXNfcmVzdWx0X3RhYmxlCmBgYAoKYGBge3J9Cm5vcm1fbWFzc19mZGl2X2FuYWx5c2lzX3ByZWRfcGxvdCA9IHBsb3RfdnN1cnBfcmVzdWx0KG5vcm1fbWFzc19mZGl2X2FuYWx5c2lzX3Jlc3VsdF90YWJsZSkKbm9ybV9tYXNzX2ZkaXZfYW5hbHlzaXNfcHJlZF9wbG90CmBgYAojIENyZWF0ZSBwbG90IG9mIGRpZmZlcmVuY2VzIGluIHByb2Nlc3MgcmVzcG9uc2UKYGBge3J9CnByZWRfbGVnZW5kIDwtIGdldF9sZWdlbmQoCiAgIyBjcmVhdGUgc29tZSBzcGFjZSB0byB0aGUgbGVmdCBvZiB0aGUgbGVnZW5kCiAgbm9ybV9od2lfZmRpdl9hbmFseXNpc19wcmVkX3Bsb3QgKyB0aGVtZShsZWdlbmQuYm94Lm1hcmdpbiA9IG1hcmdpbigwLCAwLCAwLCAxMikpCikKZ2VvX2xlZ2VuZCA8LSBnZXRfbGVnZW5kKAogICMgY3JlYXRlIHNvbWUgc3BhY2UgdG8gdGhlIGxlZnQgb2YgdGhlIGxlZ2VuZAogIG5vcm1fbWFzc19mZGl2X2FuYWx5c2lzX2dlb19wbG90ICsgdGhlbWUobGVnZW5kLmJveC5tYXJnaW4gPSBtYXJnaW4oMCwgMCwgMCwgMTIpKQopCgpwbG90X2dyaWQoCiAgcGxvdF9ncmlkKAogICAgbm9ybV9tbnRkX2FuYWx5c2lzX2dlb19wbG90ICsgdGhlbWUobGVnZW5kLnBvc2l0aW9uPSJub25lIiksIAogICAgbm9ybV9tbnRkX2FuYWx5c2lzX3ByZWRfcGxvdCArIHRoZW1lKGxlZ2VuZC5wb3NpdGlvbj0ibm9uZSIpLCAKICAgIG5yb3cgPSAxCiAgKSArIGRyYXdfbGFiZWwoIk1OVEQiLCBzaXplID0gMTYsIGFuZ2xlID0gOTAsIHggPSAwLjAxLCB5ID0gMC41KSwKICBwbG90X2dyaWQoCiAgICBub3JtX2dhcGVfZmRpdl9hbmFseXNpc19nZW9fcGxvdCArIHRoZW1lKGxlZ2VuZC5wb3NpdGlvbj0ibm9uZSIpLCAKICAgIG5vcm1fZ2FwZV9mZGl2X2FuYWx5c2lzX3ByZWRfcGxvdCArIHRoZW1lKGxlZ2VuZC5wb3NpdGlvbj0ibm9uZSIpLCAKICAgIG5yb3cgPSAxCiAgKSArIGRyYXdfbGFiZWwoIkdhcGUiLCBzaXplID0gMTYsIGFuZ2xlID0gOTAsIHggPSAwLjAxLCB5ID0gMC41KSwKICBwbG90X2dyaWQoCiAgICBub3JtX2h3aV9mZGl2X2FuYWx5c2lzX2dlb19wbG90ICsgdGhlbWUobGVnZW5kLnBvc2l0aW9uPSJub25lIiksIAogICAgbm9ybV9od2lfZmRpdl9hbmFseXNpc19wcmVkX3Bsb3QgKyB0aGVtZShsZWdlbmQucG9zaXRpb249Im5vbmUiKSwgCiAgICBucm93ID0gMQogICkgKyBkcmF3X2xhYmVsKCJIV0kiLCBzaXplID0gMTYsIGFuZ2xlID0gOTAsIHggPSAwLjAxLCB5ID0gMC41KSwKICBwbG90X2dyaWQoCiAgICBub3JtX21hc3NfZmRpdl9hbmFseXNpc19nZW9fcGxvdCArIHRoZW1lKGxlZ2VuZC5wb3NpdGlvbj0ibm9uZSIpLCAKICAgIG5vcm1fbWFzc19mZGl2X2FuYWx5c2lzX3ByZWRfcGxvdCArIHRoZW1lKGxlZ2VuZC5wb3NpdGlvbj0ibm9uZSIpLCAKICAgIG5yb3cgPSAxCiAgKSArIGRyYXdfbGFiZWwoIk1hc3MiLCBzaXplID0gMTYsIGFuZ2xlID0gOTAsIHggPSAwLjAxLCB5ID0gMC41KSwgCiAgcGxvdF9ncmlkKAogICAgZ2VvX2xlZ2VuZCwgCiAgICBwcmVkX2xlZ2VuZCwgCiAgICBucm93ID0gMQogICksCiAgbnJvdyA9IDUKKQpnZ3NhdmUoZmlsZW5hbWUoRklHVVJFU19PVVRQVVRfRElSLCAncHJvY2Vzc19yZXNwb25zZS5qcGcnKSwgd2lkdGggPSAyNTAwLCBoZWlnaHQ9NTAwMCwgdW5pdHMgPSAncHgnKQpgYGAKCgojIENvbXBhcmUgbWV0cmljcyBhZ2FpbnN0IGVhY2ggb3RoZXIKYGBge3J9CmdncGxvdChhbmFseXNpc19kYXRhLCBhZXMoeCA9IGdhcGVfd2lkdGhfZmRpdl9ub3JtYWxpc2VkLCB5ID0gbW50ZF9ub3JtYWxpc2VkLCBjb2xvdXIgPSBjb3JlX3JlYWxtKSkgKyAKICBnZW9tX3BvaW50KCkgKwogIHlsYWIoIk1OVEQiKSArIAogIHhsYWIoIkdhcGUgV2lkdGggRkRpdiIpICsKICB0aGVtZV9idygpICsgbGFicyhjb2xvciA9ICJSZWFsbSIpCmBgYAoKYGBge3J9CmdncGxvdChhbmFseXNpc19kYXRhLCBhZXMoeCA9IGhhbmR3aW5nX2luZGV4X2ZkaXZfbm9ybWFsaXNlZCwgeSA9IG1udGRfbm9ybWFsaXNlZCwgY29sb3VyID0gY29yZV9yZWFsbSkpICsgCiAgZ2VvbV9wb2ludCgpICsKICB5bGFiKCJNTlREIikgKyAKICB4bGFiKCJIV0kgRkRpdiIpICsKICB0aGVtZV9idygpICsgbGFicyhjb2xvciA9ICJSZWFsbSIpCmBgYAoKYGBge3J9CmdncGxvdChhbmFseXNpc19kYXRhLCBhZXMoeCA9IGhhbmR3aW5nX2luZGV4X2ZkaXZfbm9ybWFsaXNlZCwgeSA9IGdhcGVfd2lkdGhfZmRpdl9ub3JtYWxpc2VkLCBjb2xvdXIgPSBjb3JlX3JlYWxtKSkgKyAKICBnZW9tX3BvaW50KCkgKwogIHlsYWIoIkdhcGUgV2lkdGggRkRpdiIpICsgCiAgeGxhYigiSFdJIEZEaXYiKSArCiAgdGhlbWVfYncoKSArIGxhYnMoY29sb3IgPSAiUmVhbG0iKQpgYGAKCmBgYHtyfQptbnRkX2ZkaXZfYW5hbHlzaXMgPSBhbmFseXNpc19kYXRhICU+JSAKICBkcGx5cjo6c2VsZWN0KGNpdHlfaWQsICBtbnRkX25vcm1hbGlzZWQsIGhhbmR3aW5nX2luZGV4X2ZkaXZfbm9ybWFsaXNlZCwgZ2FwZV93aWR0aF9mZGl2X25vcm1hbGlzZWQpICU+JQogIGxlZnRfam9pbihjb21tdW5pdHlfc3VtbWFyeSkgJT4lCiAgbXV0YXRlKHVyYmFuX3Bvb2xfcGVyYyA9IHVyYmFuX3Bvb2xfc2l6ZSAqIDEwMCAvIHJlZ2lvbmFsX3Bvb2xfc2l6ZSkKbW50ZF9mZGl2X2FuYWx5c2lzCmBgYAoKYGBge3J9CmdncGFpcnMobW50ZF9mZGl2X2FuYWx5c2lzICU+JSBkcGx5cjo6c2VsZWN0KG1udGRfbm9ybWFsaXNlZCwgaGFuZHdpbmdfaW5kZXhfZmRpdl9ub3JtYWxpc2VkLCBnYXBlX3dpZHRoX2ZkaXZfbm9ybWFsaXNlZCwgcmVnaW9uYWxfcG9vbF9zaXplLCB1cmJhbl9wb29sX3NpemUsIHVyYmFuX3Bvb2xfcGVyYykpCmdnc2F2ZShmaWxlbmFtZShGSUdVUkVTX09VVFBVVF9ESVIsICdhcHBlbmRpeF9ub3JtYWxpc2VkX2NvcnJlbGF0aW9uLmpwZycpKQpgYGAKCgo=